Senior Data Engineer

Company: Washington Abstract
Location: New York
Posted on: May 4, 2025

Job Description:

• Our Mission: Increase government transparency to connect and empower. We're building an AI platform that helps businesses and individuals make sense of messy government data. Executive orders, news shifts, regulations - we're making sense of it all.
• Why: Corporations, law firms, non-profits, and individuals alike are still using spreadsheets and archaic government websites to understand how bills impact their industry. They deserve a 21st century tool that streamlines how we make sense of pending legislation, and enables a more transparent and accessible advocacy process.
• Customers: Include Fortune 500 Companies, AM Law 100 Global Law Firms, and Government Organizations.
• Team: Passionate and hungry (both literally and figuratively), looking to build cool stuff to benefit everyone!
• Where: Abstract Engineering based in NYC.
• Hybrid: Hybrid between remote and our office in DUMBO, Brooklyn RoleWe're looking for an experienced and skilled Senior Data Engineer to join our dedicated data engineering team. As a Senior Data Engineer, you will play a critical hands-on role in designing, building, and maintaining robust data infrastructure and pipelines. You'll help shape our data platform, drive architectural decisions, and ensure data reliability and scalability across the organization.Your Background
  • Technical Leadership: Provide technical leadership and mentorship to other data engineers. Foster a culture of continuous improvement and reliability while managing data-related projects and deliverables.
  • Modern Data Stack Expertise: Deep experience building data pipelines and workflows using tools like Airflow. Comfortable architecting scalable batch and streaming solutions.
  • Programming Skills: Proficiency in Python with a focus on data engineering best practices, including modular code, testing, and performance.
  • Cloud Infrastructure: Hands-on experience building in and deploying to AWS and/or GCP. Familiarity with S3, EC2, Lambda, Cloud Functions, or equivalent services.
  • Data Systems: Strong knowledge of relational and non-relational databases. Experience with data warehousing, partitioning, and performance optimization.
  • Code Quality and DevOps: You champion CI/CD, infrastructure as code, and observability. You prioritize clean, tested, and well-documented code.
  • Collaboration and Communication: Able to work cross-functionally with analysts, engineers, and stakeholders to deliver reliable data solutions.
  • Fast Learner: You quickly absorb new concepts and technologies.
  • Determination: You embrace complexity and persist through tough challenges.
  • Passionate: You're passionate about politics and increasing government transparency. Bonus Points
    • Previous experience in a managerial or team lead role
    • Experience introducing distributed data processing tools like Spark or Beam
    • Knowledge of data modeling tools and practices (e.g. dbt, data contracts)
    • Experience with Elasticsearch and implementing search on top of structured data
    • Familiarity with Terraform or other infrastructure-as-code tools
    • Strong understanding of data security, privacy, and compliance best practicesCompensationPerks and Benefits
      • Full autonomy in a high-growth startup.
      • Work with a small tight-knit team, passionate about making government more transparent and accessible via thoughtful design that is relied on by countless organizations for their daily work.Generous Time Off Benefits
        • Dental Insurance:
          - Guardian 2500 with Adult & Child Ortho
        • Vision Insurance:
          - Guardian 10/20/150
        • Life Insurance:
          - $100,000 Life401(k) with a Company Match
          • Our plan provides you an opportunity to defer compensation for your long-term savings (Pre-tax and Roth).
          • We will match up to 3.5% of your total eligible compensation.At Abstract, we're cognizant of systemic issues in our industry that have created inequalities in opportunity for many communities. We acknowledge the fact that women and underrepresented minorities are hesitant to apply for a role they feel they don't check all the boxes for. Even if you don't check all the boxes in this posting, we highly encourage you to apply anyway! It would be our pleasure to get to know you and see if you're a fit for any of our teams.We're an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.Cut through the noise and tune into what matters
            #J-18808-Ljbffr

Keywords: Washington Abstract, Milford , Senior Data Engineer, Engineering , New York, Connecticut