A big data problem 远程全职

We had a piece of code, about raster data calculation in GIS.But the program runs for a long time, nearly a week.
So we need to do some optimization, and we choice the Hadoop with Spark, now we had a PySpark environment and GeoPySpark extension.
And now there is a Jupyter-notebook online, you can write code on it, I will provide original source code that does not optimized for reference.
All you have to do is rebuild our original code using pyspark or geopyspark, our goal is 100x faster at least