Data Engineer

WebDevStudios


4 months ago

09/17/2019 10:21:23

Job type: Full-time

Category: All others


Do you enjoy working with data architecture, migrations, scripting, and servers? Are you enthusiastic to push the web forward, and better yourself? We are also passionate about the web here at WebDevStudios, so let’s chat.

YOUR DAY-TO-DAY

  • You are primarily responsible for migrating data from one web application to another according to specifications outlined by the client and defined by our Technical Strategist during the Discovery Phase.

  • Data Engineers work alongside a Project Team and other partners during the entire development life cycle of a project, as well as a supporting the project after it ships.

  • Technologies you’ll be working with include: Docker and containerization, CI orchestration tools, Linux servers, Relational databases, PHP7, Composer, etc

QUALITIES THAT MATTER TO OUR TEAM:

  • A positive attitude, a good work ethic, and enjoy helping others

  • Not afraid to ask for help, teachable, a quick study, and have the ability to be flexible when “stuff happens”

  • Understand deadlines and can complete a variety of tasks throughout the week

  • Willing to participate in company paid training courses to further their skills

  • Excited about contributing back to open-source technologies

  • Comfortable communicating via Slack and participating in video calls with their team while working remotely

RESPONSIBILITIES

  • Migrate data from one web application to another (e.g., a Drupal to WordPress migration)

  • Maintain our development, CI, and deployment infrastructure

  • Optimize client production infrastructure for maximum speed, scalability, and maintainability

  • Meet documented deadlines and complete tasks in accordance to project milestones

  • Work directly with Technical Strategists, Project Managers, and Senior Engineers on data architecture and application infrastructure

  • Communicate the status of your work to Project Managers and participate in a project team and department calls

  • Keep an accurate record of your time with our time tracking software

  • Be available during normal business hours

  • Able to work remotely, with a strong emphasis on communication and organizational skills

REQUIREMENTS

  • You have 2+ years professional experience as a Data or Backend Engineer

  • Expert level experience with data extraction, transformation and loading from various sources

  • Expert level experience with WordPress plugin and theme structure, template tags, custom post meta, internationalization, and escaping/sanitization of data

  • Expert level experience configuring and administrating relational databases like MySQL and MSSQL

  • Experience analyzing and architecting new and existing data and recommend improvements

  • Experience providing best practice guidance for data technologies

  • Experience with PHP/Bash/WP-CLI scripting to link, migrate, and process data

  • Experience with Jenkins/CircleCI/Buddy and other orchestration tools

  • Experience using AWS, Google Cloud, WPEngine, Docker and other services and tools

  • Experience with Algolia Search, ElasticSearch, Redis, or Memcache

  • Experience with local environment setup for web application development, including Docker

  • Experience with Git version control and branching strategies

  • Experience creating monitoring strategies for infrastructure

  • Ability to use a wide variety of open source technologies and tools

EXTRA CREDIT

It’s not required, but experience or interest in the following would be nice:

  • Can read, understand, and write modern PHP and JavaScript

  • Have worked on high profile WordPress web applications before

  • WordPress plugins like:

  • Advanced Custom Fields

  • Beaver Builder

  • CMB2

  • Gravity Forms

  • Yoast SEO

  • ADDITIONAL DETAILS

  • REST APIs, especially the WordPress REST API

  • Postman or other REST API tools

  • GraphQL

  • Dress code: pajamas, if you like.

  • This is a full-time, salaried position.

  • Full-time employees enjoy benefits such as Medical/Dental/Vision, Paid Time Off, 401K, Hardware stipend, and more!

  • Pay rate is based on experience and abilities.

  • Lots and lots of informal GIF sharing.

  • OH, THE BENEFITS

We know the value in supporting our employees’ holistic well-being, and we make sure our benefits package reflects our commitment to our team.

  • 100% Paid Medical

  • Paid Sick Leave

  • Unlimited Flex Time

  • 25 days paid time off

  • Work from anywhere

  • Employee 401k

  • Continuing Education

  • Parental Leave

  • Annual Company Retreat

Please mention that you come from Remotive when applying for this job.

Help us maintain Remotive! If this link is broken, please just click to report dead link!

similar jobs

  • Auth0 (US or Argentina)
    1 month ago
    Auth0 is a pre-IPO unicorn. We are growing rapidly and looking for exceptional new team members to add to our teams and will help take us to the next level. One team, one score. 

    We never compromise on identity. You should never compromise yours either. We want you to bring your whole self to Auth0. If you’re passionate, practice radical transparency to build trust and respect, and thrive when you’re collaborating, experimenting and learning – this may be your ideal work environment.  We are looking for team members that want to help us build upon what we have accomplished so far and make it better every day.  N+1 > N.

    The Data engineer will help build, scale and maintain the enterprise data warehouse. The ideal candidate will have a deep understanding of technical and functional designs for Databases, Data Warehousing and Reporting areas. The candidate should feed on challenges and love to be hands on with recent technologies.

    This job plays a key role in data infrastructure, analytics projects, and systems design and development. You should be passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source Data technologies and software paradigms.

    Responsibilities:

    • Contributing at a senior-level to the data warehouse design and data preparation by implementing a solid, robust, extensible design that supports key business flows.
    • Performing all of the necessary data transformations to populate data into a warehouse table structure that is optimized for reporting.
    • Establishing efficient design and programming patterns for engineers as well as for non-technical peoples.
    • Designing, integrating and documenting technical components for seamless data extraction and analysis.
    • Ensuring best practices that can be adopted in our data systems and share across teams.
    • Contributing to innovations and data insights that fuel Auth0’s mission.
    • Working in a team environment, interact with multiple groups on a daily basis (very strong communication skills).

    Skills and Abilities:

    • + BA/BS in Computer Science, related technical field or equivalent practical experience.
    • At least 4 years of relevant work experience
    • Ability to write, analyze, and debug SQL queries.
    • Exceptional Problem solving and analytical skills.
    • Experience with Data Warehouse design, ETL (Extraction, Transformation & Load), architecting efficient software designs for DW platform.
    • Knowledge of database modeling and design in a Data Warehousing context
    • Strong familiarity with data warehouse best practices.
    • Proficiency in Python and/or R.


    Preferred Locations:

    • #AR; #US;
    Auth0’s mission is to help developers innovate faster. Every company is becoming a software company and developers are at the center of this shift. They need better tools and building blocks so they can stay focused on innovating. One of these building blocks is identity: authentication and authorization. That’s what we do. Our platform handles 2.5B logins per month for thousands of customers around the world. From indie makers to Fortune 500 companies, we can handle any use case.

    We like to think that we are helping make the internet safer.  We have raised $210M to date and are growing quickly. Our team is spread across more than 35 countries and we are proud to continually be recognized as a great place to work. Culture is critical to us, and we are transparent about our vision and principles. 

    Join us on this journey to make developers more productive while making the internet safer!
  • 1 month ago

    Summary 

    Wikipedia is where the world turns to understand almost any topic — The Wikimedia Foundation is the nonprofit that operates Wikipedia with a small staff.  We are looking for a great data architect who wants to modernize the infrastructure underlying Wikipedia with distributed storage, services and REST interfaces.  If this excites you, we welcome you to join us.

    Description

    • Collaborate with Product Owners, Engineers and stakeholders on product discovery and improvements of our existing systems
    • Design and implement effective data storage solutions and models
    • Articulate the flow of data across our diverse range of systems
    • Ensure reusable clear service design and  documentation
    • Defining and aligning the forms and sources of data to facilitate WMF initiatives
    • Ensure monitoring system performance and identify, define and implement internal process improvements and SLOs
    • Work with Site Reliability and Operations Engineers to analyse and determine service discoverability, capacity plans and high availability
    • Recommend solutions to improve new and existing data storage and delivery systems
    • Change the world for more than half a billion people every month ;) 

    Skills and Experience

    • 3+ years experience in a Data Architect role as part of a team
    • You have a track record of leading data architecture initiatives to completion
    • You have experience analysing, reasoning about, optimising and implementing complex data systems
    • You have expertise in data handling approaches and technologies with good understanding of system development lifecycles and modern data architectures(Data Lakes, Data Warehouse)
    • You are comfortable modeling complex systems using approaches such as Domain Driven Design, eventual consistency, stream processing
    • You have experience with a diverse set of data storage and persistence frameworks and have a strong understanding of core data modelling concepts:
      • Relational & distributed databases (e.g. MySQL, Cassandra, Neo4j, Riak, HBase, DynamoDB, Elasticsearch)
      • Consistency trade-offs and transactional algorithms in distributed systems
      • Principles of fault tolerance and robustness
    • Use the best available tools & languages for each task. Currently we work a lot with Node.js but also use other tools and languages like Go, Python, Java, C, C++ and PHP where it makes sense. 
    • You have experience working with data streaming and pipelining systems(Hadoop, Kafka, Druid)
    • You have experience working with an engineering team, and communicate effectively with other stakeholders.
    • You have a track record of combining a solid long-term architectural strategy with short-term progress.
    • With freedom comes responsibility. You direct your own work and are pro-active in asking for input.
    • You have a scientific mindset and empirically test your hypotheses.
    • BS, MS, or PhD in Computer Science or equivalent work experience

    Pluses

    • Experience working with microservice architectures
    • Experience with open source technology and free culture, and have contributed to open source projects
    • Experience working remotely
    • You know what it means to be a volunteer or to coordinate the work of volunteers
    • Big ups if you are a contributor to Wikipedia
    • Please provide us with information you feel would be useful to us in gaining a better understanding of your technical background and accomplishments

    Show us your stuff! If you have any existing open source software that you've developed (these could be your own software or patches to other packages), please share the URLs for the source. Links to GitHub, etc. are exceptionally useful. 

    The Wikimedia Foundation is... 

    ...the nonprofit organization that hosts and operates Wikipedia and the other Wikimedia free knowledge projects. Our vision is a world in which every single human can freely share in the sum of all knowledge. We believe that everyone has the potential to contribute something to our shared knowledge, and that everyone should be able to access that knowledge, free of interference. We host the Wikimedia projects, build software experiences for reading, contributing, and sharing Wikimedia content, support the volunteer communities and partners who make Wikimedia possible, and advocate for policies that enable Wikimedia and free knowledge to thrive. The Wikimedia Foundation is a charitable, not-for-profit organization that relies on donations. We receive financial support from millions of individuals around the world, with an average donation of about $15. We also receive donations through institutional grants and gifts. The Wikimedia Foundation is a United States 501(c)(3) tax-exempt organization with offices in San Francisco, California, USA.

    The Wikimedia Foundation is an equal opportunity employer, and we encourage people with a diverse range of backgrounds to apply.

    U.S. Benefits & Perks*

    • Fully paid medical, dental and vision coverage for employees and their eligible families (yes, fully paid premiums!)
    • The Wellness Program provides reimbursement for mind, body and soul activities such as fitness memberships, baby sitting, continuing education and much more
    • The 401(k) retirement plan offers matched contributions at 4% of annual salary
    • Flexible and generous time off - vacation, sick and volunteer days, plus 19 paid holidays - including the last week of the year.
    • Family friendly! 100% paid new parent leave for seven weeks plus an additional five weeks for pregnancy, flexible options to phase back in after leave, fully equipped lactation room.
    • For those emergency moments - long and short term disability, life insurance (2x salary) and an employee assistance program
    • Pre-tax savings plans for health care, child care, elder care, public transportation and parking expenses
    • Telecommuting and flexible work schedules available
    • Appropriate fuel for thinking and coding (aka, a pantry full of treats) and monthly massages to help staff relax
    • Great colleagues - diverse staff and contractors speaking dozens of languages from around the world, fantastic intellectual discourse, mission-driven and intensely passionate people

    *Eligible international workers' benefits are specific to their location and dependent on their employer of record

    More information

    Wikimedia Foundation
    Blog
    Wikimedia 2030
    Wikimedia Medium Term Plan
    Diversity and inclusion information for Wikimedia workers, by the numbers
    Wikimania 2019
    Annual Report - 2017 

    This is Wikimedia Foundation 
    Facts Matter
    Our Projects
    Fundraising Report

  • What we're looking for

    Agnoris is seeking a strong engineer with experience in modern SaaS web applications tech stack to deploy a highly scalable data analysis product for the restaurants industry. 

    Responsibilities

    • Full stack feature development - from architecture and DevOps to sophisticated database queries and API middleware

    • Holistic application performance optimizations along the tech stack - serverless, caching, db admin, query optimizations etc.

    • Define strategic and tactical tech roadmap in conjunction with product roadmap

    Examples of Deliverables

    • Develop product features backend in Python + Postgres

    • Migrate API from AWS Lambda to EC2

    • Set up performance monitoring for Postgres DB

    • Optimize connection pools to Postgres

    • Introduce cashing for API

    • Optimize complex SQL queries

    • Set up ETL pipeline quality monitoring and reporting

    Qualifications

    • API middleware - GraphQL on Python (Django)

    • Advanced SQL on Postgres

    • Data manipulation in Python

    • Postgres DB admin

    • Serveless frameworks, preferably AWS Lambda

    • Data pipelines, preferably AWS SQS/SNS

    • Strong advantages - React.js experience, knowledge of statistics

    • Experience with data-driven products

    • Religious about tech tradeoffs being dictated by product value

    Benefits

    • Above market-level salary; possible equity

    • Flexibility of hours and locations

    • Ownership and independence - you're (almost) your own boss

    • Opportunity to make a dent in a very large industry

    • Working with cutting edge tech stack and an opportunity to push SaaS boundaries forward

    • Opportunity to join a YC company with strong culture

    About Agnoris and How to Apply: https://www.notion.so/agnoris/Job-Board-3734e4b044b74ad3884caaafa8bad160#a154d415a97e4754bf5960b52841d602

Remotive can help!

Not sure how to apply properly to this job? Watch our live webinar « 3 Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) ».

Interested to chat with Remote workers? Join our community!