Databricks Developer
CTG is seeking to fill a **Databricks Developer** opening for our client in Atlanta, Georgia.
**Location:** Atlanta, GA
**Duration:** 18 to 24 months
**Seeking a Pyspark and Databricks Developer with a good understanding of the entire ETL/Azure lifecycle with a background of data projects.**
**Responsibilities**
+ Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services
+ Implement and optimize Spark jobs, data transformations, and data processing workflows, Managing Databricks notebooks, Delta lake with Python, Delta Lake with Sparks SQL in Databricks
+ Leverage Azure DevOps and CI/CD best practices to automate the deployment /DAB Deployments and management of data pipelines and infrastructure
+ Ensure Data Integrity checks and Data Quality checks with zero percent errors when deployed to production
+ Understand Databricks new features Unity Catalog/Lake flow/DAB Deployments/Catalog Federation
+ Hands on experience Data extraction (extract, schemas, corrupt records, error handling, parallelized code), transformations and loads (user defined functions, join optimizations) and Production optimize (automate ETL)
**Qualifications**
+ Bachelor’s degree in computer science, Information Technology, or related field.
+ Minimum of 5 years of experience in data engineering or similar roles.
+ Proven expertise with Azure Databricks and data processing frameworks.
+ Strong understanding of data warehousing, ETL processes, and data pipeline design.
+ Experience with SQL, Python, and Spark.
+ Excellent problem-solving and analytical skills.
+ Effective communication and teamwork abilities.
**Skills**
+ Azure Databricks
+ Python
+ Apache Spark
+ SQL
+ ETL processes
+ Data Warehousing
+ Data Pipeline Design
+ Cloud Architecture
+ Performance Tuning
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.
**To Apply:**
To be considered, please apply directly to this requisition using the link provided **.** For additional information, please contact **Krista Eckard at krista.eckard@ctg.com** . Kindly forward this to any other interested parties. Thank you!
**About CTG**
CTG, a Cegeka company, is at the forefront of digital transformation, providing IT and business solutions that accelerate project momentum and deliver desired value. Over nearly 60 years, we have earned a reputation as a faster and more reliable, results-driven partner. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. CTG leverages the expertise of over 9,000 team members in 19 countries to provide innovative solutions. Together, we operate across the Americas, Europe, and India, working in close cooperation with over 3,000 clients in many of today's highest-growth industries. For more information, visit www.ctg.com .
Our culture is a direct result of the people who work at CTG, the values we hold, and the actions we take. In other words, our people define our culture. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. Part of our mission is to cultivate a workplace that attracts and develops the best people.
CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.
CTG is an Equal Opportunity Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. CTG is fully committed to promoting employment opportunities for members of protected classes.