Data Engineer, Rust

Posted 17 Days Ago
Remote
1-3 Years Experience
Information Technology • Software
The Role
Looking for a Data Engineer with deep understanding of relational databases and modern data stacks, and a desire to code in Rust. Responsible for improving Graph Node’s capabilities as a data processing and querying engine, familiarizing with the Rust codebase, using subgraphs, analyzing code, setting up performance tests, and collaborating with colleagues.
Summary Generated by Built In

Edge & Node is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering subgraphs set the industry standard and solidify The Graph as the premier solution for organizing and accessing blockchain data.

At Edge & Node, we champion a decentralized future based on shared values. Dedicated to decentralizing power and resisting censorship, we aim for a robust, permissionless information era free from central control, thus eliminating the traditional vulnerabilities associated with misplaced trust.

The Graph Network Engineering team is focused on building and maintaining core software components that make The Graph work. We are especially focused on graph-node, an Open Source Rust project that provides the core indexing capabilities of The Graph.

We are looking for a Data Engineer with deep understanding of relational databases and modern data stacks, and a desire to code in Rust. A Rust Data Engineer at E&N will not just use Rust data tools, but build our general purpose blockchain data systems and also contribute to our dependencies.

What You’ll Be Doing

  • Working within the Graph Node team to improve Graph Node’s capabilities as a data processing and querying engine
  • Familiarizing yourself with the large and complex Rust codebase that is Graph Node
  • Using subgraphs to understand both the specification implemented by Graph Node as well as the developer experience of the builders who are our users.
  • Develop an understanding of existing code and design choices, and then analyze how they can be experimented with and improved upon
  • Setting up performance tests, doing quantitative assessments of any proposals and changes you make, and monitoring how the changes ultimately behave when rolled out
  • Experimentally validating, and if necessary, falsifying your own ideas.
  • Reviewing pull requests of your colleagues and taking responsibility for the reviewed code as if it were your own
  • Documenting important aspects of the software while understanding that Graph Node has a large community of independent operators that need to understand how to run, configure, and monitor Graph Node

What We Expect

  • You’ve contributed more than 10,000 lines of code to a production software product
  • Thinking about data in SQL terms comes naturally for you
  • You have an understanding of some of the theory behind data systems, such as relational algebra, and an understanding of fundamental DB data structures and data formats, such as BTrees, LSM Trees, and compression formats
  • You have an interest in higher-level query languages such GraphQL
  • You have an interest in federated data and federated query frameworks
  • You understand how small design choices can have large effects in big data systems
  • You are comfortable working with an existing system and codebase and making fundamental improvements to it while being mindful of backwards compatibility
  • You understand tracing and debugging requirements of complex software
  • You have an understanding of the academia and theory that backs the software libraries you use but also understand the pragmatic necessity of shipping usable software quickly

Compensation/Culture

The overall market range for roles at Edge & Node is typically $100k - $500k annually. This market range is based on total compensation (vs. only base salary). Edge & Node has a culture that values meritocracy, personal growth, and an ego-free environment.

About the Graph

The Graph is the indexing and query layer of web3. The Graph Network’s self service experience for developers launched in July 2021. Developers build and publish open APIs, called subgraphs, that applications can query using GraphQL. The Graph supports indexing data from multiple different networks including Ethereum, NEAR, Arbitrium, Optimism, Polygon, Avalanche, Celo, Fantom, Moonbeam, IPFS, and PoA with more networks coming soon. To date, tens-of-thousands of subgraphs have been deployed on the hosted service, and now subgraphs can be deployed directly on the network. Over 28,000 developers have built subgraphs for applications such as Uniswap, Synthetix, KnownOrigin, Art Blocks, Balancer, Livepeer, DAOstack, Audius, Decentraland, and many others.

If you are a developer building an application or web3 application, you can use subgraphs for indexing and querying data from blockchains. The Graph allows applications to efficiently and performantly present data in a UI and allows other developers to use your subgraph too! You can deploy a subgraph to the network using the newly launched Subgraph Studio or query existing subgraphs that are in the Graph Explorer. The Graph would love to welcome you to be Indexers, Curators and/or Delegators on The Graph’s mainnet. Join The Graph community by introducing yourself in The Graph Discord for technical discussions, join The Graph’s Telegram chat, and follow The Graph on Twitter, LinkedIn, Instagram, Facebook, Reddit, and Medium! The Graph’s developers and members of the community are always eager to chat with you, and The Graph ecosystem has a growing community of developers who support each other.

The Graph Foundation oversees The Graph Network. The Graph Foundation is overseen by the Technical Council. Edge & Node, StreamingFast, Messari, Semiotic  and The Guild are five of the many organizations within The Graph ecosystem.

Top Skills

Rust
The Company
HQ: San Francisco, CA
61 Employees
On-site Workplace
Year Founded: 2021

What We Do

The initial team behind The Graph. Building a vibrant decentralized future.

Jobs at Similar Companies

Fusion92 Logo Fusion92

Account Executive

AdTech • Agency • Digital Media • Enterprise Web • Marketing Tech • Analytics • Web3
IL, USA
263 Employees

ForeFlight Logo ForeFlight

Product Designer II

Aerospace • Software • App development
Remote
Austin, TX, USA
466 Employees

IonQ Logo IonQ

Lead Ion Trap Design Engineer

Artificial Intelligence • Hardware • Information Technology • Internet of Things • Software
Easy Apply
Seattle, WA, USA
305 Employees

Snap Inc. Logo Snap Inc.

Application Engineer, Salesforce UI

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
New York, NY, USA
5000 Employees

Similar Companies Hiring

Instacart Thumbnail
Software • Retail • Food • eCommerce
San Francisco, CA
3000 Employees
Toast Thumbnail
Software • Information Technology • Hospitality • Food • Fintech • Cloud
Boston, MA
4500 Employees
Block Thumbnail
Software • Payments • Fintech • Financial Services • eCommerce • Cryptocurrency • Blockchain
Oakland, CA
12000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account