Position Details: Spark/Scala Developer

Description:

Full job description here...

• Note
• – The location is HYD and Bangalore with 5 days WFO.

Skill
Spark/Scala
No of Position
4
Must Have Skill
Scala frame works - ETL and AWS Glue
Good to Have Skill
Migration and Modernization
Work Location
Bangalore and Hyderabad
Rounds of interview
R1 + R2
Experience Level
4 years to 8 years
Mode of interview (Virtual/ In-person)
Virtual
Work timing
5 Days WFO
Work Mode (Remote/ On-site/ Hybrid)
Hybrid
Below are the must-have skillsets for a Scala practitioner:

• *Spark execution fundamentals:
• can explain shuffles, stages, lazy eval, and join types
• *Performance diagnosis skill:
• can read and explain plan and name first metrics/logs to check for a 10× slowdown.

• *Skew + small-files awareness:
• has concrete strategies for skewed joins and small-files/compaction on S3.

• *Correctness & rerun safety:
• designs idempotent batch outputs; has a credible backfill/rerun story that avoids duplicates/corruption.

• *Scala proficiency for distributed compute:
• understands driver vs executor, closure/serialization pitfalls, and uses type-safe patterns competently.

• *Data layout competence:
• chooses Parquet/ORC, file sizing, and partitioning based on access patterns.

• *AWS lake platform basics:
• practical knowledge of S3, Glue Catalog and how IAM/KMS fit for secure data processing
• *Operational maturity:
• has testing, data-quality checks and monitoring/alerting
• *UDF discipline:
• prefers built-in Spark SQL functions; can justify when a UDF is truly needed

Perform an action: