Scala Coding Project

The scope of work: - rewrite the code in simple, optimized and clean Scala - document the code o explain each block of code in detail / pseudocode o explain each object used o have a clear identification of the impact of each parameters o identify and document each module implement specific business rules Volume wise It’s managing 10 Millions of row per day. There is 3 main programs covered in this code, - one simple that do some data merge, - one that manage a graph database (complexity unknown), - one that do multiple complex data manipulation, preparing intermediate files, then applying a specific business algorithm with a lot of exceptions ( specific business rules ). The code is on linux, using Spark, the files are on linux and HDFS We find that the code is not optimized, messy on at least the following points: - reduce, map, etc.. operations are chained too long which makes it hard to follow the logic, and understand intermediate result - objects are not named meaningfully (Variables, functions, tuples) - there is a lot of large unnamed tuples and RDD without explanation of the content - there is not much comments in code So we would like a quotation in cost and timeframe to - rewrite the code in simple, optimized and clean Scala (see point listed above) - document the code o explain each block of code in detail / pseudocode o explain each object used o have a clear identification of the impact of each parameters o identify and document each module implement specific business rules Project may require some time to be spent at our client's office in Hong Kong. Timescales and deadline to be confirmed.