Job Title: Senior Software Engineer
Education: Masters or foreign equivalent in Computer Science, Information Systems or related field
Experience: 2 years of experience as a Senior Software Engineer or related occupation.
Special Requirements: Must have at least 1 year of prior work experience in each of the following:
- Redesigning online analytics engine to introduce theta sketching framework & eliminate HBase to address performance, scalability, extensibility, maintenance.
- Launching a fully automated log ingestion project completely using AWS cloud services like Data Pipeline, EMR, Glue.
- Designing & developing nightly data pipeline using MapReduce, Pig, Spark to process peta-bytes of behavior data.
- Translating high-level business requirements into working solutions using relational DB table design, implementation, & tuning.
- Working on real-time streaming data integration service to ingest behavior data using agile/scrum methodologies with short release cycles.
- All the following environments: AWS, Hadoop, MapReduce, Spark/Scala, Spring, HDFS, HBase, Java, Oozie, Jenkins, Hive, Pig, Sqoop, Postgres, Bash, Pentaho.