Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

Yk1zRlkxUm1yeGVHT2FLNDZ3NDQ5K2UzYUE9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

EFP Staffing

Staffing Recruiter Job at EFP Staffing

 ...and follow-through. Building systems. Building relationships. Building something that lasts. What You Bring: Experience in staffing or agency recruiting preferably in light industrial, clerical, or professional roles. A relentless work ethic and a calm mind... 

Sazerac

PLC Programmer Job at Sazerac

 ...be assigned.Qualifications/RequirementsIndustrial electrical and/or instrumentation background is required. AC drives and strong PLC programming and troubleshooting experience with Allen Bradley is highly recommended. Electro-mechanical skills are a plus.The ideal... 

BBSI

Payroll Specialist Job at BBSI

 ...Barrett Business Services, Inc. (BBSI) helps business owners focus on their business. We offer outsourced HR, risk consultation, payroll administration, insurance, and recruiting to small-and medium-sized businesses. We combine expert knowledge with industry leading solutions... 

Brightstar Care of Carlsbad

Part Time Per Diem LVN for Home Healthcare Job at Brightstar Care of Carlsbad

Part Time & Per Diem Opportunities for Licensed Vocational Nurses (LVN / LPN)!Looking to earn extra money with schedule flexibility?Our home health nurses work 1:1 with patients in their homes, serving clients across Carlsbad, Oceanside, Vista, Fallbrook and Camp... 

Innovatix Technology Partners

Visual Designer Job at Innovatix Technology Partners

 ...Title: Visual Designer Location: Bothell, WA (onsite) Duration: 12 Months *** W2 - USC or GC only *** Required Skills: Expert in Visual & UI Design (layout, color, topography, hierarchy) Visual Designing native mobile apps are a MUST have (UI for...