BigData Expert/Developer - Locals only - Redmond, WA - Full Time

BigData Expert/Developer - Locals only - Redmond, WA - Full Time

Thanks & Regards

Balaji Bobby

KRG Technologies, Inc.,

661 367 8000 Ext :251

ØBuild the Event Hubs integration with Service Fabric micro services implementation. Streaming the processed files from blobs into EH for downstream processing.

ØAnonymized files (~1000 of them and to a size of ~GB) will be given as input

ØService Fabric code portion will be provided.

ØBuild the Spark processing reading off EventHubs, implementation in either Python or Scala would suffice.

ØLook at the caching needs; leverage .cache to retain appropriate results from Spark ‘Actions’ in Spark executors

ØOur team will evaluate a set of data store that would be a landing spot post Spark – Blobs being a required one. We will pick 1 or 2 from this list -- SQL DW, Azure SQL DB, Cassandra and DocumentDB being other candidate stores and we will have code snippets and/or guidance

Øon latency, throughout with percentiles.

ØLeverage APM tools as appropriate

Qualifications

Locals only - Redmond, WA

Additional Information

Client - HCL America Inc / MicroSoft