Data Engineer


2 days ago

02/23/2020 10:22:00

Job type: Full-time

Category: Software Development


Wikipedia is where the world turns to understand almost any topic — The Wikimedia Foundation is the nonprofit that operates Wikipedia with a small staff.  We are looking for a great data architect who wants to modernize the infrastructure underlying Wikipedia with distributed storage, services and REST interfaces.  If this excites you, we welcome you to join us.


  • Collaborate with Product Owners, Engineers and stakeholders on product discovery and improvements of our existing systems
  • Design and implement effective data storage solutions and models
  • Articulate the flow of data across our diverse range of systems
  • Ensure reusable clear service design and  documentation
  • Defining and aligning the forms and sources of data to facilitate WMF initiatives
  • Ensure monitoring system performance and identify, define and implement internal process improvements and SLOs
  • Work with Site Reliability and Operations Engineers to analyse and determine service discoverability, capacity plans and high availability
  • Recommend solutions to improve new and existing data storage and delivery systems
  • Change the world for more than half a billion people every month ;) 

Skills and Experience

  • 3+ years experience in a Data Architect role as part of a team
  • You have a track record of leading data architecture initiatives to completion
  • You have experience analysing, reasoning about, optimising and implementing complex data systems
  • You have expertise in data handling approaches and technologies with good understanding of system development lifecycles and modern data architectures(Data Lakes, Data Warehouse)
  • You are comfortable modeling complex systems using approaches such as Domain Driven Design, eventual consistency, stream processing
  • You have experience with a diverse set of data storage and persistence frameworks and have a strong understanding of core data modelling concepts:
    • Relational & distributed databases (e.g. MySQL, Cassandra, Neo4j, Riak, HBase, DynamoDB, Elasticsearch)
    • Consistency trade-offs and transactional algorithms in distributed systems
    • Principles of fault tolerance and robustness
  • Use the best available tools & languages for each task. Currently we work a lot with Node.js but also use other tools and languages like Go, Python, Java, C, C++ and PHP where it makes sense. 
  • You have experience working with data streaming and pipelining systems(Hadoop, Kafka, Druid)
  • You have experience working with an engineering team, and communicate effectively with other stakeholders.
  • You have a track record of combining a solid long-term architectural strategy with short-term progress.
  • With freedom comes responsibility. You direct your own work and are pro-active in asking for input.
  • You have a scientific mindset and empirically test your hypotheses.
  • BS, MS, or PhD in Computer Science or equivalent work experience


  • Experience working with microservice architectures
  • Experience with open source technology and free culture, and have contributed to open source projects
  • Experience working remotely
  • You know what it means to be a volunteer or to coordinate the work of volunteers
  • Big ups if you are a contributor to Wikipedia
  • Please provide us with information you feel would be useful to us in gaining a better understanding of your technical background and accomplishments

Show us your stuff! If you have any existing open source software that you've developed (these could be your own software or patches to other packages), please share the URLs for the source. Links to GitHub, etc. are exceptionally useful. 

The Wikimedia Foundation is... 

...the nonprofit organization that hosts and operates Wikipedia and the other Wikimedia free knowledge projects. Our vision is a world in which every single human can freely share in the sum of all knowledge. We believe that everyone has the potential to contribute something to our shared knowledge, and that everyone should be able to access that knowledge, free of interference. We host the Wikimedia projects, build software experiences for reading, contributing, and sharing Wikimedia content, support the volunteer communities and partners who make Wikimedia possible, and advocate for policies that enable Wikimedia and free knowledge to thrive. The Wikimedia Foundation is a charitable, not-for-profit organization that relies on donations. We receive financial support from millions of individuals around the world, with an average donation of about $15. We also receive donations through institutional grants and gifts. The Wikimedia Foundation is a United States 501(c)(3) tax-exempt organization with offices in San Francisco, California, USA.

The Wikimedia Foundation is an equal opportunity employer, and we encourage people with a diverse range of backgrounds to apply.

U.S. Benefits & Perks*

  • Fully paid medical, dental and vision coverage for employees and their eligible families (yes, fully paid premiums!)
  • The Wellness Program provides reimbursement for mind, body and soul activities such as fitness memberships, baby sitting, continuing education and much more
  • The 401(k) retirement plan offers matched contributions at 4% of annual salary
  • Flexible and generous time off - vacation, sick and volunteer days, plus 19 paid holidays - including the last week of the year.
  • Family friendly! 100% paid new parent leave for seven weeks plus an additional five weeks for pregnancy, flexible options to phase back in after leave, fully equipped lactation room.
  • For those emergency moments - long and short term disability, life insurance (2x salary) and an employee assistance program
  • Pre-tax savings plans for health care, child care, elder care, public transportation and parking expenses
  • Telecommuting and flexible work schedules available
  • Appropriate fuel for thinking and coding (aka, a pantry full of treats) and monthly massages to help staff relax
  • Great colleagues - diverse staff and contractors speaking dozens of languages from around the world, fantastic intellectual discourse, mission-driven and intensely passionate people

*Eligible international workers' benefits are specific to their location and dependent on their employer of record

More information

Wikimedia Foundation
Wikimedia 2030
Wikimedia Medium Term Plan
Diversity and inclusion information for Wikimedia workers, by the numbers
Wikimania 2019
Annual Report - 2017 

This is Wikimedia Foundation 
Facts Matter
Our Projects
Fundraising Report

Please mention that you come from Remotive when applying for this job.

Help us maintain Remotive! If this link is broken, please just click to report dead link!

similar jobs


    Build intelligent tools that help communities adapt to the impacts of climate change.

    Hi! We're Forerunner.

    We believe that adaptation is a necessity, not a luxury, and all communities should have access to powerful software that helps them plan for the future. The challenge of climate change is complex — it implicates how municipalities plan, manage capital, and communicate to both residents and higher levels of government. Forerunner helps local communities do these things better by empowering them to access, understand, and mobilize local-level flood risk data at scale. Our software is built to be easy-to-use, so that the planners and floodplain managers preparing for our future can focus on the important stuff.

    Currently, we're working with a handful of communities, including the City of New Orleans and Pinellas County, FL. Our engineering team is hard at work on projects that involve extracting information from permits, managing complex datasets, and incorporating geospatial data. Our mission is ambitious, and we have a significant amount of work ahead. As our newest team member, you'll be joining us at a crucial time when you'll have a real impact on our direction and our partner municipalities' success.

    About the position:

    We're looking for a senior full-stack engineer with 5+ years of experience to join us. We would love to hear from you if you're interested in what we do and have a proven track record of leading mid- to large-scale technical initiatives. In general, you might be a good fit if you:

    • Have partial, or full, familiarity with our technical stack: Node, GraphQL, React, Postgres + PostGIS, Heroku. If not, we would like you to be confident in your ability to ramp up quickly.

    • Are comfortable with a high degree of ambiguity. Since we are constantly learning a lot from our partners, we are looking for someone who has a bias toward action and can balance the challenging trade-off between quality and speed.

    • Consider yourself to be a great communicator. We're a small team working remotely, which requires us to be prompt and clear with written and spoken communication.

    Our team has a lot to offer.

    Forerunner is a seed-stage company with an interdisciplinary team. We are motivated by seemingly intractable problems and work hard to support one another.

    • We're mission driven. Our mission orients our business strategy and pushes us to work with a sense of urgency. We’re in the weeds — our entire team spends time engaging with our partners in the field to better understand the real-world challenges they face.

    • We're a small team. We're currently 4 people — you will be the 5th. As a member of our growing team, you will quickly become an invaluable part of our organization and have a meaningful impact on our business and technical direction. We welcome unique perspectives and backgrounds. Your opinion matters and we hope you'll share it.

    • We're remote. While many of us are based in NYC, we're happy to have you work where you are happiest and most productive. We offer schedule flexibility and ask for accountability in return.

    • We want you to be happy and healthy. Forerunner offers competitive compensation, health/vision/dental coverage (we pay 70%), and commuter benefits. We also have a quarterly wellness reimbursement so that you can have flexibility in defining what health means to you.

    We look forward to meeting you. To apply or ask questions, shoot us a message at [email protected]!

  • 2 weeks ago
    Who are we?

    Flyt is a technology platform designed to connect the world’s top food delivery companies with the world’s largest restaurant brands. If you have ordered food on your phone you have touched our technology.

    Today, we’re a global company, with our technology being deployed across Europe, North America and Australia, and with team members in six countries. Yet we’re still human-scale: everyone can get to know everyone, and we are structured to ensure every team has a strong sense of community and autonomy on how to hit their goals.

    Flyt is organised in small, cross-functional, autonomous teams we call squads. Each one of our squads owns an area of the product end-to-end and is responsible for meeting a business goal. Same principles as the Spotify model, but customised to what works for us.

    The Role

    We’re looking for a Senior Go Developer to join one of our teams. You'll be helping big restaurant brands like McDonald’s, Burger King or KFC connect their systems to our platform and enable new mobile and web experiences.


    What you'll be doing

    Here’s what your day-to-day looks like:

    • Building new microservices on an event-based architecture. Golang, Kafka, AWS.
    • Engaging directly with customers and partners to connect their services to our platform
    • Sharing new standards and best practices with the wider engineering team
    • Helping decide the best next thing to do so you meet your quarterly team goals
    • Taking full ownership of your microservices: from coding and testing them to running them once they’re live
    Working with us

    You’ll love working here if:

    • You can’t wait to roll up your sleeves and build a great product with a dedicated team
    • You love having a goal, and having the autonomy to decide the best way to go for it
    • You obsess over personal growth. Feedback, Coaching, Learning, Teaching.
    • You like to communicate transparently (all our #slack channels are public!), and are willing to listen to your peers, earn trust and show up curious


    • Salary: £75,000 to £95,000 pa
    • Flexibility to truly work remotely
    • Access to coaches on leadership, product, tech and sales
    • Top spec Macbook Pro to enable you to do your job well
    • The training budget you need to help you level-up
    • A quarterly £££ bonus pool
    • 25 days holiday pa
    • Quarterly meets at different locations around the world where we all get together, plan for the next quarter and have some fun!
    • The opportunity to work in a fast-growing company with global expansion plans and operations spanning Europe, North America and Australia.
  • InVision is the digital product design platform used to make the world’s best customer experiences. We provide design tools and educational resources for teams to navigate every stage of the product design process, from ideation to development. Today, more than 5 million people use InVision to create a repeatable and streamlined design workflow; rapidly design and prototype products before writing code, and collaborate across their entire organization. That includes 100% of the Fortune 100, and organizations like Airbnb, Amazon, HBO, Netflix, Slack, Starbucks and Uber, who are now able to design better products, faster.  

    Our team is in search of a Staff Backend Engineer to help us change the way digital products are designed.

    About the Team:

    The Discoverability squad's charter is to enable teams to efficiently find, organize,  and manage their artifacts inside InVision. At InVision, we know that time is precious for our users. Users want to find the InVision content they seek in the most efficient and expedient manner possible. The Discoverability squad owns a large and important product surface area and operates with the goals of improving our users’ experience and speed when navigating and managing their InVision content.

    What you’ll do:

    • Continuously push the limits in Go and Node JS
    • Work in a microservice SPA environment
    • Ensure your software delivery includes unit, integration, and end-to-end testing. Ensure software is designed with long-term maintainability in mind
    • Ensure optimal performance and scalability of your software, which may include partnering with backend engineers, Product Managers, and Designers
    • Work alongside Design partners to iterate on the best user experience possible
    • Build best-in-class features with effective and compelling microinteractions
    • Ensure you and your teammates are following good development practices and getting better every day while continuously improving deployment and test practices
    • Participate in Code Reviews and provide feedback to your fellow engineers

    What you’ll bring:

    • 8+ years of hands-on experience with Go and modern backend frameworks
    • Experience with a shared component architecture
    • A high degree of personal accountability
    • A ‘can do’ attitude - you are willing to roll up your sleeves to solve problems without obvious solutions
    • A commitment to releasing feature work to delight our customers
    • A desire to learn continuously
    • A positive environment for the people around you

    About InVision:

    InVision offers an incredibly unique work environment. The company employs a diverse team all over the world. Each InVision team member is given the freedom and tools to do their best work from wherever they choose.

    The benefits we offer in the United States and Canada include competitive health plans and retirement plans. Some InVision-wide benefits offered to all employees across the globe include a flexible vacation policy, monthly coffee shop stipends, annual allowances for books related to your profession, and home office setup & wellness reimbursements. InVision is an international employer so some benefit offerings will vary from country to country.

    InVision is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

Remotive can help!

Not sure how to apply properly to this job? Watch our live webinar « 3 Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) ».

Interested to chat with Remote workers? Join our community!