portal resources jobs companies m maystreet inc. data engineer

Data Engineer


MayStreet has an immediate opening for a Data Engineer. This is a full-time remote position. We are looking for a passionate and enthusiastic problem-solver with an interest in capital markets data to join us as we continue providing technology innovation and support to the world’s leading global capital markets companies.



In this role, you will work alongside a talented and open-minded data team that works on mission-critical applications within capital markets technology. You will have the opportunity to contribute in all phases of the development lifecycle – from suggesting the use of emerging technologies to designing, integrating, and upgrading complex architecture.



Who we are



MayStreet is a global software company Headquartered in New York City, servicing the world’s top capital markets trading companies. We’re building the next generation of capital markets technology. Global capital markets are an ocean of fast-moving, interrelated and complex data. Historically it’s been nearly impossible for all but a select few firms to make use of much of this data. MayStreet solves this problem by managing collection, storage and API access to uniquely high-quality data sets.



Current strategic pursuits



The Data Engineer will be responsible for MayStreet's data processing pipelines. MayStreet has the mission of 'Capturing, Storing and Transforming' the world's market data. Our data team manages the data pipelines that flow between each of those stages. The role has a large operational component while also requiring someone to envision future growth in both utilization and technology selection for the components of the work.



Work qualifications





  • Strong proficiency with Linux and an understanding of Linux server architecture and operation. Should be very comfortable with data copying, scheduling tasks and Linux daemons.


  • Significant experience with Python. Ability to write and maintain object-oriented Python applications is a must.


  • Proficiency with Bash / Shell Scripting.


  • Experience with processing job management – experience using one or more of the following: Jenkins, Rundeck, Apache Airflow or other task scheduling software


  • Time spent working in a batch data processing environment or other environment where large data jobs are performed using automation


  • Experience with ETL pipelines and Data Lakes


  • Git version control systems - GitLab and/or GitHub




Nice to haves, but not required





  • C/C++ programming experience


  • Experience with AWS data warehouse, Redshift, Athena, Dremio or Snowflake


  • Experience with Google Cloud BigQuery


  • Experience with and knowledge of US and International market data


  • Experience with multicast market data


  • Experience with monitoring and visualization systems such as Nagios, Prometheus and Grafana


  • Experience with time series databases


  • Experience with AWS S3


  • Experience with Docker and Kubernetes




MayStreet perks





  • Competitive compensation


  • Company paid medical, dental and vision insurance package


  • 401K with matching


  • Company stock options


  • Generous personal-time-off package


  • Entrepreneurial, fun environment


  • Small team with growth opportunity


  • Exposure to all aspects of the financial technology services industry




MayStreet is an equal opportunity employer.





Other openings you might be interested in

Senior Internal Apps Developer

Senior Internal Apps Developer

ABOUT THE INTERNAL APPLICATIONS & AUTOMATION TEAM We serve any team inside the company. When a team engages our services, we’re accountable for delivering solutions to their problems relating to workflows and tooling. For example, we deliver: * Tool

6m ago
Lead Application Developer / Technical Project Manager

Lead Application Developer / Technical Project Manager

100% Remote: This role allows working remotely 100% of the time from anywhere in the US. Workers must be authorized to work in the US (No Non US Applicants Please). Who We Need: We are looking for experienced senior software developers to act as lead

today
Full Stack JavaScript Developer

Full Stack JavaScript Developer

ABOUT THE POSITION GTN Technical Staffing is seeking a JavaScript Software Engineer - Vue.JS / Node for a Direct-Hire opportunity, 100% remote. This position may be performed remotely anywhere within the United States except the State of Colorado. Th

today
Frontend Developer

Frontend Developer

Hyperobjekt is a digital agency specializing in design, web development and data visualization for the nonprofit sector and social impact projects. We have collaborated with Pulitzer Prize-winning authors, transformational organizations, and preemine

today
Full Stack Developer

Full Stack Developer

Kunai is looking for a full-time Full Stack Developer to join our team. We're a growing digital agency of 60+ people that is fully remote. During the past decade, we've shipped over 150 products for clients that include Visa, the United Nations, Well

today
Content Developer and Editor

Content Developer and Editor

Our Founder, an inspiring author and education leader, seeks a full-time Executive Assistant. The position will support her in both her professional and personal life and will require exceptional organisational and writing skills. Responsibilities in

this week
PHP Developer

PHP Developer

MindSource is looking for an experienced with a strong background in the LAMP environment and Solid OOP skills in PHP 7.2+. Job Title: PHP Developer Location: 100% Remote Duration: Full time Interview Process: Phone Interview + Take home Challenge +

yesterday
Backend/Full stack Laravel PHP developer

Backend/Full stack Laravel PHP developer

Company  Since 2012, Blazing Boost Srl is one of the leading companies providing in-game services to video game players of various well-known online video games. We enable casual gamers of World of Warcraft, Destiny 2, and other games to play with, g

this week
More remote jobs

Other jobs at MayStreet Inc.

3 jobs in the last 60 days · 7 in total · avg 0 - 1 jobs/mo · 1004 job visits

Data Engineer

Data Engineer

MayStreet has an immediate opening for a Data Engineer. This is a full-time remote position. We are looking for a passionate and enthusiastic problem-solver with an interest in capital markets data to join us as we continue providing technology innov

this week
C++ Developer

C++ Developer

MayStreet Inc. has immediate openings for C++ developers. This is a full-time remote position. We are looking for passionate and enthusiastic problem-solvers with an interest in capital markets data to join us as we continue providing technology inno

last week
DevOps Engineer

DevOps Engineer

MayStreet Inc. has immediate openings for DevOps Engineers. This is a full-time remote position in the US only. We are looking for passionate and enthusiastic problem-solvers with an interest in capital markets data to join us as we continue providin

7w ago
Senior Technical Writer

Senior Technical Writer

MayStreet Inc. has immediate opening for a Senior Technical Writer. Building on recent successes, MayStreet now needs a self-starter who can quickly deliver documentation supporting its world-class market data transformation and delivery platforms. T

4m ago
DevOps Engineer

DevOps Engineer

MayStreet Inc. has immediate openings for DevOps Engineers. This is a full-time remote position in the US only. We are looking for passionate and enthusiastic problem-solvers with an interest in capital markets data to join us as we continue providin

5m ago
Frontend Engineer

Frontend Engineer

MayStreet Inc. has immediate openings for a Frontend Engineer. This is a full-time remote position. We are looking for passionate and enthusiastic problem-solvers with an interest in capital markets data to join us as we continue providing technology

11m ago
Site Reliability Engineer

Site Reliability Engineer

MayStreet Inc. has immediate openings for Site Reliability Engineers (SRE). This is a full-time remote position. We are looking for passionate and enthusiastic problem-solvers with an interest in capital markets data to join us as we continue providi

11m ago
MayStreet Inc.