Role: Data Engineer Databricks / Python / Database
Bill Rate: $70/hour C2C
Location: Jersey city, NJ
Duration: 12+ months/ long-term
Interview Criteria: Telephonic + Teams
Direct Client Requirement
Overview:We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and Database engineering. The ideal candidate will design, build, and optimize scalable data pipelines, ensure data quality, and support advanced analytics and business intelligence initiatives across the organization.
Key Responsibilities:Design, build, and maintain ETL/ELT workflows on Databricks.
Develop scalable data pipelines using Python and Spark.
Optimize data transformation logic for performance and cost efficiency.
Work with structured and unstructured data from various sources.
Develop and manage data models, schemas, and tables across databases (SQL/NoSQL).
Implement data quality, validation, and monitoring frameworks.
Collaborate with Data Scientists, Analysts, and Cloud Engineers to support analytics and ML workloads.
Ensure data security, governance, and compliance in all solutions.
Troubleshoot pipeline failures and continuously improve pipeline reliability.
Integrate data from APIs, streaming sources, and cloud storage.
Required Skills:
Core Technical Skills:-Databricks (mandatory) – Delta Lake, Notebooks, Spark SQL, Jobs, Workflows
Python – Data processing, Spark APIs, automation, optimization
Database Engineering – Strong SQL, query tuning, schema design, stored procedures
Apache Spark – RDDs/DataFrames, optimisation, partitioning
Cloud Platforms (one or more): AWS / Azure / GCP
ETL/ELT tools: ADF, Glue, Dataflow, or equivalent
Experience working with large-scale datasets
CI/CD for data pipelines (Git, DevOps, Jenkins, etc.)
NOTE: Thank you for visiting our jobs page. Please submit your application using the Apply Now link. Our recruitment team is currently reviewing all applications thoroughly. We will be in touch with candidates who are shortlisted for the next stage of the interview process.
Valiant Technologies LLC
166 Geary St
San Francisco, CA 94108
Phone: (415) 935-9966
srinivasa.kandi@valianttec.com
Tags: Srinivasa Reddy Kandi, #SrinivasaReddyKandi, @SrinivasaReddyKandi, Srinivasa Kandi, #SrinivasaKandi, @SrinivasaKandi, Kandi Srinivasa Reddy, #KandiSrinivasaReddy, @KandiSrinivasaReddy
Apply Now