Data Engineer Job at Input Technology Solutions, Honolulu, HI

cmFndEFoQkc1QUl1MXNXSCtxbjdXNElVbmc9PQ==
  • Input Technology Solutions
  • Honolulu, HI

Job Description

Input Technology Solutions is seeking a Data Engineer to support a program in Honolulu, HI. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure, pipelines and systems. Proficiency in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks is crucial for ensuring efficient data ingest, processing and analysis. You will develop and manage ETL processes and data pipelines across various government platforms, working with a wide range of data types.

What you will do:

  • Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
  • Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
  • Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
  • Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
  • Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
  • Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
  • Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
  • Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
  • Maintain documentation for software applications, workflows, and processes.
  • Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.
What you need to have:
  • Bachelor's Degree and 0 to 2 years of experience; 6 to 8 years with no degree
  • Clearance:TS/SCI clearance
  • 1+ years of Python experience including developing, running, packaging, and testing Python scripts
  • Experience with distributed version control systems (VCS)
  • Experience with the entire ETL/ELT pipeline, including data ingestion, data normalization, data preparation, and database design
  • Experience with conducting exploratory data analysis to communicate qualitative and quantitative findings to analysts
  • Experience processing and fusing structured and unstructured data
  • Experience with data engineering projects supporting data science and AI/ML workloads
  • Experience creating solutions within a collaborative, cross-functional team environment in team sprint cycles
  • Bachelor’s degree
What we'd like you to have:
  • Experience with using Palantir products for data manipulation, correlation, and visualization
  • Experience with AWS or other cloud computing services
  • Experience with Kafka and NiFi development
  • Experience with containerization tools, including Docker and Kubernetes
  • TS/SCI with Counterintelligence Polygraph

Job Tags

Similar Jobs

Hearing Healthcare Recruiters

Audiologist or Hearing Aid Specialist Wanted Job at Hearing Healthcare Recruiters

HEARING HEALTHCARE RECRUITERSis proud to present this opportunity in the beautiful state of Maryland!We are seeking an Audiologist or a Hearing Aid Specialist in the Gaithersburg, MD area who is motivated by his/her career in the hearing industry!The candidate for... 

Focus Staff

Travel Medical Technologist/Med Tech Job at Focus Staff

We currently have a client looking for a Medical Technician (Traveling Medical Technician) Focus Staff is seeking a traveling Certified Medical Technician, who will perform detailed and complex analyses of patient specimens. The position recognizes problems, identifies... 

Souter Limestone and Minerals, LLC

Heavy Equipment Operator: Experience Wheel Loader/Excavator/Haul Truck Operator Job at Souter Limestone and Minerals, LLC

 ...Heavy Equipment Operator (Second Shift, 5pm to 3am) Experienced Wheel Loader / Excavator / Haul Truck Operator ~ Second Shift Pay Differential Will Apply Job Summary: Souter Limestone and Minerals is currently seeking second shift heavy equipment operators... 

Aleto, Inc.

Interior Designer/Architect- Falls Church, VA. Job at Aleto, Inc.

 ...Job Title: Interior Designer/Architect Job Type: Full-Time/Exempt Location: Hybrid ,...  ...Aleto specializes in federal property management, space planning, and facility management...  ...Strategist, Space Planner, and Project Manager. This role combines expertise... 

Hunter Dunning

Interior Design Project Manager Job at Hunter Dunning

 ...Interior Design Project Manager Job in Culver City, LA Interior Design Project Manager Job available with a leading architecture and design firm, focused on workplace / corporate interiors projects. Offering a salary in the region of $100,000 - $140,000 plus extensive...