DS Technologies Inc
Engineer II – Big Data / Apptio / ETL
About the job
Job Title: Engineer II – Big Data / Apptio / ETL
Location: New York, NY (Onsite)
Position Type: Contract
Only W2
Job Description:
We are seeking a highly motivated Engineer II (Big Data Engineer) with strong technical expertise in Apptio, Big Data, MS SQL, Oracle PL/SQL, Python, PySpark, and ETL/Data Warehousing. The ideal candidate will support data engineering, analytics, reporting, and financial/IT cost transparency initiatives leveraging Apptio and enterprise data platforms.
Key Responsibilities:
• Develop and maintain Big Data pipelines using PySpark, Python, and other data engineering tools.
• Work with Apptio for IT financial management, cost modeling, and reporting.
• Perform ETL development for large-scale Data Warehousing and analytics systems.
• Develop and optimize MS SQL Server objects (queries, stored procedures, SSIS packages, SSRS reports).
• Write efficient Oracle PL/SQL code for RDBMS-based applications.
• Analyze, transform, and process structured/unstructured data for reporting and insights.
• Collaborate with business teams to gather requirements and deliver analytical solutions.
• Troubleshoot data issues, improve data quality, and ensure system performance.
• Document data flows, technical specs, and operational processes.
Required Skills:
• Hands-on experience with Apptio (cost transparency, reporting, ITFM tools).
• Strong knowledge of Big Data technologies (Hadoop, Spark, PySpark).
• Proficiency in MS SQL Server, including SSIS and SSRS.
• Strong SQL coding with RDBMS (MS SQL, Oracle).
• Experience with Oracle PL/SQL programming.
• Good command of Python for scripting and automation.
• Strong understanding of ETL processes and Data Warehousing concepts.
• Experience working in Data Analytics environments.
Preferred Skills:
• Experience with cloud platforms (AWS, Azure, GCP).
• Knowledge of visualization tools (Tableau, Power BI).
• Familiarity with IT cost modeling and financial analytics.
• Understanding of Agile methodologies and CI/CD workflows.