Data bricks Developer

Full Time
  • Full Time
  • India

Website CosMicIT CosMic IT

Find Your Dream Job Here

Hello Everyone,

We at #CosMicIT are looking for a #Frontend Developer

Location: PAN India
Experience: 7+Years

Job Description:

• Administer, manage, and optimize the Databricks environment to ensure efficient data processing and pipeline development.
• Perform advanced troubleshooting, query optimization, and performance tuning in a Databricks environment.
• Collaborate with development teams to guide, optimize, and refine data solutions within the Databricks ecosystem.
• Ensure high performance in data handling and processing, including the optimization of Databricks jobs and clusters.
• Engage with and support business teams to deliver data and analytics projects effectively.
• Manage source control systems and utilize Jenkins for continuous integration.
• Actively participate in the entire software development lifecycle, focusing on data integrity and efficiency within Databricks.

• Experience: More than 3 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS Databricks.

 Technical Skills:
• Proficiency in Databricks platform, management, and optimization.
• Strong experience in AWS Cloud, particularly in data engineering and administration, with expertise in Apache Spark, S3, Athena, Glue, Kafka, Lambda, Redshift, and RDS.
• Proven experience in data engineering performance tuning and analytical understanding in business and program contexts.
• Solid experience in Python development, specifically in pySpark within the AWS Cloud environment, including experience with Terraform.
• Knowledge of databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar) and advanced database querying.
• Experience with source control systems (Git, Bitbucket) and Jenkins for build and continuous integration.
• Understanding of continuous deployment (CI/CD) processes.
• Experience with Airflow and additional Apache Spark knowledge is advantageous.
• Exposure to ETL tools, including Informatica.

If any of these openings sound familiar to you or any of your known networks, please share the resume/CV to CV@cosmic-it.com

Any references would also be accepted.

Regards,

CosMicIT GmbH, Germany 🇩🇪

CosMicIT Informatics India Pvt Ltd. 🇮🇳

CosMicIT Spolka Z Ograniczona Odpowiedzialnoscia, Poland

www.CosMic-IT.com | www.CosMic-IT.in

https://www.linkedin.com/company/cosmic-it

#resume #connections #jobopening #hiring #jobseekers #jobs #recruitment #jobsearch #job #hr #recruiting #references #recruiters #opentonetwork #hiring #jobopening #experience #CosMicIT #indiajobs #india

To apply for this job email your details to cv@cosmic-it.com


APPLY FOR JOB