Palantir Data Engineer

Job Title: Palantir Data Engineer
Job ID: 85604
Location: Lawrenceville, New Jersey


Overview:
A Palantir Data Engineer designs, builds and maintains complex, scalable data pipelines within the Palantir Foundry platform.  Key responsibilities include; integration, processing, managing large datasets using PySpark/Python and SQL, creating data models and collaborating with cross-functional teams to drive AI enabled production ready analytics.


What you will be doing:

• Pipeline Development: Build, maintain and optimize robust data pipelines and workflows in Palantir Foundry using Python, PySpark and SQL.

• Data Modeling & Quality: Develop ontologies, map datasets to objects, and ensure high data quality, lineage, and security.

• System Optimization: Monitor and tune performance for large-scale data processing.

• Work with business stakeholders and engineers to translate requirements into technical solutions.Platform Maintenance: Ensure Foundry platform uptime, managing data ingestion and integration. 

What you must have:

• 2-3 years' in data engineering, ETL workflows and big data tech (i.e. Spark, Kafka, AWS).

• Strong proficiency with Python, PySpak, SQL and data modelling.

• Palantir expertise should include certification in Palantir Foundy (Code Repos, Workbook, Pipeline Builder).

• Experience within Agile environments and ability to work with large, complex datasets.

• Common technology tools include; JIRA, Git, Confluence.

• Platform Tools include;  Palantir, Docker/Kubernetes, AWS (S3, Glue).