Senior Data Engineer

DealTracker


1 week ago

10/09/2019 10:21:36

Job type: Full-time

Salary: $48k – $72k

Category: All others


Here's to the crazy ones. The hackers. The doers. The passionate geeks in a world of corporate drones.

A cool, fully-remote startup is looking for a Senior Data Engineer… preferably one that does NOT suck! You must be speaking Python better than your mother tongue, and an expert when it comes to data pipelines.

First, let's get one thing out of the way. We know that our salaries are low, at least for the exceptional talent we're looking for. We plan to dramatically increase salaries by the end of the year when we raise a seed round. We have already attracted serious interest from top investors, but we're intentionally bootstrapping on our own till our public launch in time for Black Friday.

On top of the salary, you'll get generous stock options, performance-based bonuses, and annual profit share, as well as extensive training and mentoring, BUT…

You must be a perfectionist — you're simply too passionate about your work to call something "done" when it's not near perfect yet!

Do you remember how "Monica" from F.R.I.E.N.D.S was obsessed with the little details? Now, imagine if she became a software engineer somehow… Do you think this is you?

Okay, we want to hire you if you...

  • have 3+ years of data engineering hands-on experience with exposure to a wide array of BigData tools like task queues, message brokers, stream-processing frameworks, and AWS' data stack

  • have experience managing large-scale data pipelines in production

  • are proficient with Python2.7 and Python3 alike

  • have expert-level proficiency with ETL and data modeling

  • know your way around AWS, for real. [SQS, S3, Lambda, EC2, etc.]

  • are familiar with AWS Lambda and Serverless architecture

  • are skillful with web scraping using tools like Selenium and Scrapy

  • have ninja-level skills with SQL (PostgreSQL/MySQL)

  • are proficient with UNIX and Shell Scripting

  • are comfortable working with petabyte-scale, billion-row datasets

It would be "nice" if you...

  • are skillful with backend development using Python, Django, and DRF (HUGE PLUS)

  • have experience with applied Machine Learning and recommender systems

  • have experience with any of these technologies: ElasticSearch, Golang, SQLAlchemy, Apache Kafka, or React Native

  • have DevOps experience and are familiar with either Terraform, CloudFormation, or AWS CDK

  • are not afraid of frontend work; React.js, Next.js, JavaScript, HTML, or CSS

On top of that, you...

  • are passionate about making an impact in an early-stage startup with a kickass product

  • are productive, attentive, and self-driven

  • are familiar with Agile methodologies and CI/CD

  • have strong communication skills and fluency in English

  • can work in a fully remote environment

  • document and test your code

  • have Sherlock Holmes-like detective skills; you know how to dive deep into data investigations to identify unknown problems and debug data anomalies.

As a senior data engineer, you will...

  • architect, build, and maintain batch/real-time data processing pipelines

  • integrate a wide variety of data sources; third-party APIs, data feeds, etc.

  • build advanced web scrapers and crawlbots on top of AWS Lambda

  • take part in managing our Big Data infrastructure on AWS

  • develop creative solutions to our data problems with robust, production-ready code

  • build tools to automate data cleaning and ingestion

  • architect and implement a robust infrastructure for optimal ETL and distributed storage

Are you the real deal? Let's talk!

There's plenty of cool things to do; data processing pipelines, lots of integrations and APIs, infrastructure, and even a possibility of working with ML-powered deal recommendation engine.

If any of these things fall into your area of expertise and you're up for a challenge building a 10x product alongside a team of A-player hackers, now is the time to apply. You'll be joining us at the perfect time.

Need proof that we're building a kickass product? Check out our AngelList profile for a quick overview and some screenshots.

We'll hire the best engineer for the job regardless of your location. Timezones are not a problem as long as you're able to overlap with us for 3 hours a day. Our process is super fast, and you'll know our final decision within ten days max, so let's talk!

Please mention that you come from Remotive when applying for this job.

Help us maintain Remotive! If this link is broken, please just click to report dead link!

similar jobs

  • Brave Software (US or Canada)
    2 weeks ago

    We are looking for an experienced data engineer to be responsible for the design, development and maintenance of large data collection and processing systems at Brave. This position will focus on scaling our backend systems to handle the increased load of data collection, processing and presentation.

    Responsibilities:

    • The position would primarily work with the statistics and engineering teams, along with day to day communication with the product and marketing team.

    • Design and develop AWS systems to collect and manage business events at scale.

    • Respond to request from the product, engineering and marketing team for timely data analysis.

    • Participate in multi-team planning for future data collection needs.

    Requirements:

    • Strong AWS skills with extensive knowledge of the data collection, storage and processing systems that AWS provides. Experience building ETL pipelines at scale.

    • Familiarity with Redshift, Kinesis, Athena, Glue, Data Pipeline, MongoDB, Postgresql.

    • Strong JavaScript and SQL skills.

    • Extensive knowledge of modern open source software develop practices and tools i.e. Git, Github, Unit and integration testing, pull requests, code review etc…

    Additional qualities:

    • Strives to deliver clean, maintainable and testable code

    • Has a passion for user privacy

    • Is open to learning new languages and frameworks

    • Has a soft spot for JavaScript

     Benefits

    • Competitive salary

    • 4 weeks (20 days) of paid vacation per year

    • Excellent medical coverage

    • Generous 401k plan

    • Stock option grant

    • Travel and conference budgets

    • Commuters benefit (On­site only)

    • Hip office in the SoMA neighborhood of SF

    Candidates must be legally authorized to work in the United States or Canada.

  • Emptor (US timezones)
    2 weeks ago

    Emptor is looking for a Senior QA Engineer (SDET) to join the team and build/maintain a fully automated end-to-end test strategy for multiple API versions and data pipelines. Our mission is to build and implement a fully developed end to end set of automated tests for any associated APIs across a series of different implementations and data pipelines. You must have an outstanding working knowledge of functional, unit, and automation testing and be capable of building new framework structures. We will rely on you to generate well articulated test cases and determine the positive, negative and boundary cases from working with our cross-functional teams in a fast-paced, agile, and release driven environment.


    About the team

    This team is highly distributed across the globe and you will thrive in an environment of remote work and asynchronous communication. Our team members span a variety of timezones, genders, ethnicities, cultures, experience levels, professional backgrounds, personality types, and more. You're expected to have strong written communication skills and to excel in working relationships with people different than you.


    Location

    Remote - Global team, 8:00 AM UTC-5 to 8:00 PM UTC-5.


    Requirements

    • Willing to work around the Americas timezones

    • Extensive experience with Python, AWS services (S3, DynamoDB, CloudWatch, ECS), agile software development environment

    • Comfortable with building customer test automation frameworks

    • Must have a minimum of 2 years experience testing multi-tier, complex networked applications

    • Parsing and analysis of free-form and fixed-form data sets

    • Good problem solving and debugging skills

    • Comfortable working in an Agile development environment

    • Experience executing API tests

    • Broad experience designing and maintaining automated tests for whitebox and blackbox testing

    • Experience with unit testing frameworks

    • Experience with libraries used to implement web requests automation

    • Knowledge of best practices for the Software Development Life Cycle (SDLC)

    • Working knowledge of JIRA or other issues tracking software

    • Experience with Git or other distributed revision control and source code management systems

    Expectations

    Practices & Behavior:

    • Define, develop, and implement quality assurance practices and procedures in a fully automated solution

    • Develop automated tests using open source tools

    • Configure and maintain test automation environments

    • Work closely with engineering teams and other organizations in the company to promote software quality standards

    • Work closely with Customer Support to replicate customer issues and product field use cases

    • Participate in test team activities including requirements analysis, test planning, tracking, reporting, and support of test cycles

    • Engage in test case execution including defect documentation and tracking, resolution support, and fix verification

    • Test, analyze, and address issues with products and features.

    • Collaborate on and inform cross-functional teams of new feature technical design, technical requirements, limitations, and implementation.

    • Follow an iterative software development methodology and contribute to all phases of the software development lifecycle and support.

    • Articulate development status to technical and non-technical audiences.

    • Continually refine business acumen and establish domain/industry vertical expertise.

    Note: Emptor will not sponsor applicants for work visas.

    If you’re interested and want to apply please write to [email protected] with the subject  “Quality Assurance Engineer”

  • Job description

    Lead the evolution of our next-gen Data Warehouse to enable our Data Science & Analytics teams in developing insights that genuinely drive our business, and that of our international clients. What is waiting for you here is a company that moves fast and where data is a top priority. No red tape to cut through. If you have a vision and you want to use your business intelligence skills to apply the newest technologies, this is your chance! 

    Your job

    You will deal with plenty of complexity since we work with a multitude of clients for whom we need to integrate many data in very distinct ways. Along with two colleagues, you make sure that all these data are effectively fed into our data warehouse to enable state of the art reporting & analytics. As an architect, we'll further challenge you by bringing everything we do to the cloud. You also ensure that our data warehouse can keep up with the rapid growth of our business. And, you will strategize on the inclusion of non-operational data sources that will enable exciting insights for our clients. Imagine being able to combine our data, with game usage data, to predict in-game spending, for example. 

    Our current platform is modern and mostly built in the cloud (Azure). It is a microservices based, large distributed system. We believe in continuously evaluating our stack, and we have a smooth process of suggesting and adopting new technologies. Our set of technologies: 

    • SQL server, analysis services tabular, power BI 

    • R, Python 

    • Azure Functions, Azure ML, Azure VM's 

    • What you bring!

    Requirements

    To do this job, you should be able to: 

    • Architect and own the technological innovation;

    • Advise on and implement new technologies and future improvements;

    • Conceive, design, develop and deploy the data architecture and data models from scratch;

    • Collaborate across business units (Operations, Reporting and Analysis, Data Science) to craft a vision, strategy, and roadmap;

    • Train and mentor the team in data modeling and data quality related processes and standards;

    • Communicate fluently in English, allowing you to operate comfortably in a highly international organization;

    • Adapt easily within an environment where things move fast.

    How to apply

    Feel eager to apply? Let's get to know each other! Please help us to understand how you see yourself matching up. A list of technologies is great, yet what we are especially excited to learn about is your ability to lead with vision and fulfil the role of an actual architect. So, don't hold back to tell us more about that! For most vacancies, an online assessment is part of the application process.

    About us

    We are 5CA. For the past 20 years, we've used our expertise to help our clients build  their CX & support strategy. Focused on three industries: video games, consumer electronics, and eCommerce, we provide omnichannel support in a wide variety of languages, always using the latest technological innovations.    

    We’re headquartered in Utrecht, The Netherlands, with offices in Los Angeles, Buenos Aires, and Hongkong. For our contact services, we use a mix of onsite and remote support specialists. A highly flexible and dynamic model, by which we help our clients deal with challenging situations.    

    5CA offers a fast-paced, dynamic workplace where every day is different, and developments take place in days, not months. Our culture is shaped by a spirited workforce, hailing from all corners of the globe. We all share a thirst for new and exciting technology and gaming as the binding factor. 5CA has a flat hierarchy, where you are encouraged to think big, dream big, and live up to your full potential. 

Remotive can help!

Not sure how to apply properly to this job? Watch our live webinar « 3 Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) ».

Interested to chat with Remote workers? Join our community!