The Palantir Data Engineer leverages advanced Python skills within a small team to develop and implement data transformation pipelines in Palantir's environment. The Data Engineer will also integrate with external systems via API, parse API responses into usable data objects, design user interfaces, and develop custom functions with TypeScript. Data Engineer will conduct code reviews, solution brainstorming, and define UI designs and functionalities. Successful candidate must be able to perform tier 2 level triage with customers and translate concerns into specific requirements. Ability to effectively triage requirements and articulate impacts on the existing environment is critical to mission success. Data Engineer will also develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions.
Activities include the following tasks: Movement of structure and unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. Develop code to format data that supports exploration. Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives. Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models. Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions.
Clearance: Active TS/SCI with Full Scope Polygraph (Required).
Experience: 3–5 years of professional experience in data engineering.
Palantir Ecosystem: Expert proficiency in Palantir Foundry, Pipeline Builder, and Workshop.
Programming: Advanced Python skills for complex data transformations.
Front-End Development: Proficiency in TypeScript for custom functions and UI development.
API Integration: Proven ability to integrate external systems via API and parse complex responses.
Customer Triage: Demonstrated history of performing Tier 2 triage and translating customer concerns into technical requirements.
ETL/O&M: Strong background in developing new ETL processes and performing O&M on legacy code using industry best practices.
Technical Documentation: Experience delivering comprehensive project documentation, including ETL mappings and code guides.
Collaborative Design: Ability to lead solution brainstorming sessions and define UI/UX functionalities.