Pyspark Databricks Engineer Job at CrackaJack Digital Solutions LLC, Houston, TX

YmM4TFpWWmlyaEtJUDZ1NjZBbzk5ZVcyYmc9PQ==
  • CrackaJack Digital Solutions LLC
  • Houston, TX

Job Description

Job Title: PySpark and Databricks Developer
Location: Houston, TX (Hybrid)

Key Responsibilities:
  • Design, develop, and optimize data pipelines and transformations using PySpark and Databricks .
  • Collaborate with data architects and analysts to define and implement scalable data models and frameworks.
  • Build and maintain complex data ingestion and processing workflows for large, distributed datasets.
  • Develop reusable and efficient code following best practices in coding, testing, and deployment.
  • Optimize Spark jobs for performance, scalability, and reliability in production environments.
  • Work closely with cross-functional teams to ensure data quality, consistency, and integrity.
  • Contribute to continuous improvement of the data engineering ecosystem and CI/CD processes.
Required Skills and Qualifications:
  • 5+ years of experience in software development with a focus on Python and PySpark .
  • Hands-on expertise in Databricks platform — including cluster management, notebooks, and job orchestration.
  • Strong programming fundamentals (data structures, algorithms, debugging, version control).
  • Experience with Delta Lake , Spark SQL , and data lake architectures .
  • Solid understanding of distributed computing, data partitioning, and Spark performance tuning.
  • Familiarity with cloud platforms such as Azure, AWS, or GCP.
  • Excellent communication and problem-solving skills — able to explain complex technical concepts clearly.

Job Tags

Contract work,

Similar Jobs

The University of Mississippi

Assistant/Associate Director of Football Operations Job at The University of Mississippi

 ...Athletics Department is conducting a search for Assistant/Associate Director of Football Operations. This position assists in managing the...  ...against any employee or applicant for employment based upon race, color, gender, sex, pregnancy, sexual orientation, gender identity... 

Genesys Works

Director of Corporate Engagement (Washington) Job at Genesys Works

 ...national leader in providing pathways to career success for high school students in underserved communities through skills training,...  ...partnerships that generate revenue for the organization and provide internships for the students we serve. You will be responsible for... 

Global Connect Technologies

UI/Xamarine Developer Job at Global Connect Technologies

 ...Company We are looking for a talented and motivated .NET/MAUI Developer to join our engineering team focused on embedded UI development. The successful candidate will play a key role in designing and implementing intuitive, high-performance user interfaces for... 

Finastra

Principal Business Consultant (Loan IQ) (Austin) Job at Finastra

 ...Reporting to the Director of Lending Global Services, the Principal Business Consultant is responsible for data analysis and mapping, system...  ...standards within established timeframes and at defined quality levels, and ensure projects are completed according to schedule and... 

Compass Group

STEWARD (FULL TIME) Job at Compass Group

 ...achieve their full potential. Both full-time and part-time associates are eligible for the following benefits: Opportunities for Training and Development Retirement Plan Associate Shopping Program Health and Wellness Programs Discount Marketplace...