Senior Data Engineer

DealTracker


3 months ago

10/09/2019 10:21:36

Job type: Full-time

Salary: $48k – $72k

Category: All others


Here's to the crazy ones. The hackers. The doers. The passionate geeks in a world of corporate drones.

A cool, fully-remote startup is looking for a Senior Data Engineer… preferably one that does NOT suck! You must be speaking Python better than your mother tongue, and an expert when it comes to data pipelines.

First, let's get one thing out of the way. We know that our salaries are low, at least for the exceptional talent we're looking for. We plan to dramatically increase salaries by the end of the year when we raise a seed round. We have already attracted serious interest from top investors, but we're intentionally bootstrapping on our own till our public launch in time for Black Friday.

On top of the salary, you'll get generous stock options, performance-based bonuses, and annual profit share, as well as extensive training and mentoring, BUT…

You must be a perfectionist — you're simply too passionate about your work to call something "done" when it's not near perfect yet!

Do you remember how "Monica" from F.R.I.E.N.D.S was obsessed with the little details? Now, imagine if she became a software engineer somehow… Do you think this is you?

Okay, we want to hire you if you...

  • have 3+ years of data engineering hands-on experience with exposure to a wide array of BigData tools like task queues, message brokers, stream-processing frameworks, and AWS' data stack

  • have experience managing large-scale data pipelines in production

  • are proficient with Python2.7 and Python3 alike

  • have expert-level proficiency with ETL and data modeling

  • know your way around AWS, for real. [SQS, S3, Lambda, EC2, etc.]

  • are familiar with AWS Lambda and Serverless architecture

  • are skillful with web scraping using tools like Selenium and Scrapy

  • have ninja-level skills with SQL (PostgreSQL/MySQL)

  • are proficient with UNIX and Shell Scripting

  • are comfortable working with petabyte-scale, billion-row datasets

It would be "nice" if you...

  • are skillful with backend development using Python, Django, and DRF (HUGE PLUS)

  • have experience with applied Machine Learning and recommender systems

  • have experience with any of these technologies: ElasticSearch, Golang, SQLAlchemy, Apache Kafka, or React Native

  • have DevOps experience and are familiar with either Terraform, CloudFormation, or AWS CDK

  • are not afraid of frontend work; React.js, Next.js, JavaScript, HTML, or CSS

On top of that, you...

  • are passionate about making an impact in an early-stage startup with a kickass product

  • are productive, attentive, and self-driven

  • are familiar with Agile methodologies and CI/CD

  • have strong communication skills and fluency in English

  • can work in a fully remote environment

  • document and test your code

  • have Sherlock Holmes-like detective skills; you know how to dive deep into data investigations to identify unknown problems and debug data anomalies.

As a senior data engineer, you will...

  • architect, build, and maintain batch/real-time data processing pipelines

  • integrate a wide variety of data sources; third-party APIs, data feeds, etc.

  • build advanced web scrapers and crawlbots on top of AWS Lambda

  • take part in managing our Big Data infrastructure on AWS

  • develop creative solutions to our data problems with robust, production-ready code

  • build tools to automate data cleaning and ingestion

  • architect and implement a robust infrastructure for optimal ETL and distributed storage

Are you the real deal? Let's talk!

There's plenty of cool things to do; data processing pipelines, lots of integrations and APIs, infrastructure, and even a possibility of working with ML-powered deal recommendation engine.

If any of these things fall into your area of expertise and you're up for a challenge building a 10x product alongside a team of A-player hackers, now is the time to apply. You'll be joining us at the perfect time.

Need proof that we're building a kickass product? Check out our AngelList profile for a quick overview and some screenshots.

We'll hire the best engineer for the job regardless of your location. Timezones are not a problem as long as you're able to overlap with us for 3 hours a day. Our process is super fast, and you'll know our final decision within ten days max, so let's talk!

Please mention that you come from Remotive when applying for this job.

Help us maintain Remotive! If this link is broken, please just click to report dead link!

similar jobs

  • Students enroll in Thinkful courses to gain the valuable technical and professional skills needed to take them from curious learners to employed software developers. As an Immersive Course Instructor, you will deliver high quality live workshop content based on existing curriculum, preparing students to successfully transition careers. 

    In addition to working directly with students, Instructors are expected to maintain an environment of regular, candid feedback with the Educator Experience team, and to stay on top of important updates via meetings, email, and Slack. Ideal candidates for this team are highly coachable, display genuine student advocacy, and are comfortable working in a complex, rapidly changing environment. 

    Responsibilities:

    -Delivers high quality workshops based on the curriculum materials, and provides live coding demos when appropriate, to supplement written materials and content to provide students with the skills and knowledge to get their first developer job 

    -Maintains and updates the daily and weekly student syllabus which outlines the required homework and assignments, and deadlines for assessments and projects 

    -Provides up to 2 hours daily of on-demand video and chat support for students as they move through the program assignments 

    -Spends up to 4 hours a day prepping for workshops and updating course materials

    -Works with the other Format Leads for engagement formats (Mentor Sessions, Group Sessions, Grading, Technical Coaching, Mock Interviews/Assessments) to ensure that consistent experience is happening for students in immersive courses 

    -Provide constructive feedback to the Instructional Design team on improvements to the course materials and curriculum based on student experience with the materials 

    Requirements:

    -Strong expertise with Excel, Tableau, PowerPoint, SQL, and Python, and comfort explaining these topics.

    -Ability to explain complicated topics clearly and without jargon

    -Strong written and verbal communication skills

    -High level of detail orientation and an exceptional work ethic

    -Enjoy working with people, not just putting your head down and working

    -Must have a reliable, high-speed Internet connection

    -Minimum 3-4 years of professional data analytics experience

    -Teaching Experience, especially in a remote or online class, is a plus

    -Must be eligible to work in the United States 

    Compensation and Benefit

    -Ability to work remotely with partially flexible hours 

    -Access to all available course curriculum for personal use

    -Membership to a global community of over 500 Software Engineers, Developers, and Data Scientists who, like you, want to keep their skills sharp and help learners break into the industry

    At this time, we are unable to consider applicants from the following states: Alaska, Delaware, Idaho, New Mexico, North Dakota, South Carolina, South Dakota, West Virginia, and Wyoming

  • 1 week ago

    At Fitbit, our mission is to help people lead healthier, more active lives by empowering them with data, inspiration and guidance to reach their goals.

    We started our journey in 2007—as a team of two with one big idea. Since then, we’ve grown to over 1,700 employees, sold over 90mm devices, and built a health and wellness community across the globe. In fact, the Fitbit Community has taken enough steps to walk from the Sun to Pluto and back again! Offering award-winning products, a top-rated mobile app and an easy-to-use dashboard, Fitbit provides personalized experiences that help our users reach their goals. With a reenergized focus on innovative devices, interactive experiences, and enterprise health we are transforming the way consumers and businesses see health & fitness.

    From your first steps as a Fitbitter, you will be at the forefront of developing new products. Our culture combines the spirit of startup with the perks of being public. We offer a competitive benefits package and amazing perks like unlimited snacks, Friday happy hours, a wellness stipend, and a strong focus on a healthy work-life balance. As part of our team, you’ll have the opportunity to grow your career, contribute your ideas to life-changing products and services, and—above all—have fun doing it.

    Fitbit’s HQ campus is located in the heart of San Francisco with office locations in Boston, San Diego, Salt Lake City and around the world. Think you’ve found your fit?

    The Role:

    Fitbit is an engineering driven company with a focus on providing a great, consistent, and continuously available user experience. Our customers are uploading their tracking data and viewing their stats all the time, so site performance is critical to customer satisfaction. We're looking for someone to join our Infrastructure Engineering organization to help us build new services and evolve our existing platform.

    You'll work on challenging technical problems that support hundreds of engineers and hundreds of millions of Fitbit's customers. You'll develop and design software automation and tooling to drive efficiencies and help us scale core infrastructure that our key services are built upon.

    What You'll Work With:

    Our tooling for Infrastructure Engineering is largely written in Python and Go. However, there are some opportunities to work with Java if you're collaborating outside of the team.

    On a daily basis, this team is building tools and supporting infrastructure with: Terraform, Vault, Docker, Kubernetes, Aurora/Mesos, and Prometheus.

    An excellent candidate will demonstrate existing knowledge in a number of the tools we use as well as an ability to both teach others and learn new skills.

    It Would Be Great if You Have:

    • Significant experience (4+ years) in working with scalable public clouds like AWS or GCP.

    • Proficiency in programming and testing Go or Python.

    • Strong understanding of Linux systems and containers.

    • Previous experience in Kubernetes, Aurora/Mesos, Terraform, Bazel, or Vault.

    • An understanding of security principles and ability to work with InfoSec to address vulnerabilities and collaborate on future changes.

    • Demonstrated skill in automating operational needs and developing tools at scale.

    • A history of thorough documentation.

    • The ability to coordinate and communicate effectively whether it's emails, documentation, or video conferencing.

    • Worked with remote teams before.

    Key Traits:

    • Self-motivated and driven to succeed.

    • Exceptional communication and organization skills.

    • Your code is easily readable, but also can operate reliably.

    • Proficient at learning new tools/systems and sharing that knowledge within the team

    • Genuine curiosity and love for your craft.

    • Willingness to travel to occasionally and effectively communicate with internal teams.

    • Able to summarize information at varied granularity based on the intended audience.

    • Skilled at planning and executing simultaneous projects and activities. Ability to prioritize and keep complicated projects moving forward.

    • Able to build prototypes for new systems and vet their operation

    • History of relevant open source contributions is a plus.

    • Thrive in an evolving operational environment, responding to occasional unexpected production level issues.

    Do this sound like you? Unsure about some of the qualifications? We'd still love to hear from you.

    Fitbit is proud to be an equal opportunity employer. We recruit, hire, train, promote, pay, and administer all personnel actions without regard to race, color, ancestry, national origin, citizenship, religion, age, sex (including pregnancy, childbirth, and medical conditions related to pregnancy, childbirth, or breastfeeding), sex stereotyping (including assumptions about a person’s appearance or behavior, gender roles, gender expression, or gender identity), sexual orientation, gender, gender identity, gender expression, marital status, medical condition, mental or physical disability, military or veteran status, genetic information or other statuses protected by law. We interpret these protected statuses broadly to include both the actual status and any perceptions and assumptions made regarding these statuses.

    San Francisco applicants:  Pursuant to the San Francisco Fair Chance Ordinance Fitbit will consider for employment qualified applicants with arrest and conviction records.

  • About us 

    Beat is one of the most exciting companies to ever come out of the ride-hailing space. One city at a time, all across the globe we make transportation affordable, convenient, and safe for everyone. We also help hundreds of thousands of people earn extra income as drivers. 

    Today we are the fastest-growing ride-hailing service in Latin America. But serving millions of rides every day pales in comparison to what lies ahead. Our plans for expansion are limitless. Our stellar engineering team operates across a number of European capitals where, right now, some of the world’s most ambitious and talented engineers are changing how cities will move in the future.

    Beat is currently available in Greece, Peru, Chile, Colombia, Mexico and Argentina. 

    About the role

    Our Big Data team is an essential ingredient in Beat's aggressive growth plan and vision for the future.

    As a Senior Big Data Software Engineer in our teams, you will tackle some of the hardest problems and your work will impact the entire Beat experience, from making sure drivers are always available for all our passengers, to helping our drivers utilise their working hours. Our team moves very fast, so you'll have the opportunity to make an immediate difference.

    With the various tools and communication technologies we're using, you'll feel connected to your team from wherever you are in the world. Our remote workforce always has the option to travel to our headquarters for meetings, events, and team bonding—or they can join virtually. Whatever works best for you and your work style. 

    What you'll do day in day out:

    • Work with the data science and engineering teams in translating complex models and algorithms into production-grade software systems.

    • Develop components that will analyse, process and react to operational feeds in near real-time, optimizing driver allocation, service pricing and preventing fraudulent use of our services in near real-time.

    • Being agile both within and across teams, bridging software engineering and data science.

    What you need to have:

    • At least one Master's degree in Math, Physics, Computer Science or Engineering. Higher degrees are a significant bonus as is considerable experience with Big Data Analytics and Statistical Analysis in the industry.

    • At least 5 years of experience in developing production-grade software using either Data Warehousing or Big Data frameworks in order to solve real-world problems.

    • Experience in developing with Scala at an idiomatic, expert level is required. Knowledge of advanced Java or C++ is a bonus. We would favour candidates with an exceptionally strong engineering background.

    • At least 6 years of hands-on experience with SQL and NoSQL databases.

    • Proven hands-on experience with Apache Hadoop, Kafka, Spark or Flink.

    • Exposure to designing streaming and batch data pipelines.

    • Applied knowledge in Machine Learning algorithms and their application to vast datasets is considered as a plus.

    • A strong sense of ownership in your work.

    • Excellent numerical and analytical skills with an excellent eye for detail working with qualitative and quantitative data.

    • The desire to build, launch and iterate on quality products on time with minimal technical compromises under a loosely-managed working environment.

    What's in it for you:

    • Competitive salary package

    • Flexible working hours

    • High tech equipment and top line tools

    • A great opportunity to grow and work with the most amazing people in the industry

    • Being part of an environment that gives engineers large goals, autonomy, mentoring and creates incredible opportunities both for you and the company

    • Please note that you will be working as contractor.

    • As part of our dedication to the diversity of our workforce, Beat is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, disability, sexual orientation, gender identity, or religion.

Remotive can help!

Not sure how to apply properly to this job? Watch our live webinar « 3 Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) ».

Interested to chat with Remote workers? Join our community!