ShredStream is a service and technology in the Solana ecosystem that allows receiving blockA collection of validated transactions appended to the ledge... More fragments (“shreds“) with the lowest possible latencyThe delay between issuing an RPC call (or any network reques... More directly from the network’s leading validators.
At Solana, a shredA small piece of block data that Solana uses to break up led... More is a chunk of data containing part of the transactions of a block, generated by the leader during the production of the block.
The leader validatorA node that actively participates in the consensus process b... More splits transactions into multiple shards to efficiently propagate them to other nodes using the Turbine protocol, and these shards are then reassembled on the receiving nodes to reconstruct the entire block.
ShredStream takes advantage of this mechanism: instead of waiting for a complete block to be confirmed or broadcast in full, a nodeAny server or computer running the Solana client software, p... More or service with ShredStream receives each shred in real time (via UDP) as the leader broadcasts them.
Technically, ShredStream consists of a proxy or special connection to one or more validators (for example, through the Jito Block Engine in the case of Jito Labs) that resend those block fragments as soon as they are produced.
The proxy keeps the connection active by using heartbeat (beats) to continue receiving shreds continuously. By default, the proxy listens for UDP shreds on a specific port (e.g. 20000/udp) on the client machine, being able to inject that data directly in the blockstore from a local Solana node to rebuild the block ahead of time.
Essentially, ShredStream delivers the same data that will make up a block (transactions, inputs, block signature, etc.), but in the form of unassembled chunks.
Each shred contains portions of the transactions and metadata (signatures, encrypted data) as sent by the leader. On their own they are not immediately usable to obtain, for example, a readable list of transactions, until they are decoded and reassembled into a complete block.
In practice, this means that a developer using ShredStream typically also runs a Solana node or a ledgerThe complete record of all confirmed transactions and state ... More to reconstruct the blocks from the shreds received.
Once assembled, the resulting transactions and states can be accessed with the same fidelity as if they had come from a normal RPC, but crucially with a time advantage before a traditional public RPC even sees that block.
In summary, ShredStream technically works as an ultra-fast broadcast channel: the leading validators send the block fragments (shreds) via UDP to the other validators according to a propagation tree (Turbine).
A ShredStream service connects to this stream at a privileged level (close to the sender) to intercept/receive those fragments immediately and retransmit them to its clients.
In this way, ShredStream subscribers obtain the raw data of the block in real time, saving hundreds of milliseconds compared to traditional methods. This is critical in an environment like Solana, where blocks are generated approximately every 400-500 ms.
The main difference between ShredStream and a traditional Solana RPC (Remote Procedure Call)A protocol that enables external clients to execute operatio... More is the way and speed in which chain information is delivered:
A traditional RPC (for example, querying a public node or via WebSocket subscription) typically provides transactionA signed data packet that contains instructions to transfer ... More and block data after that the block has been produced and propagated on the network.
Even using blockSubscribe or programSubscribe subscriptions in WebSocket/gRPC, the RPC node usually receives the entire block with some delay, since RPC (non-validating) nodes are typically at the end of the Turbine propagation tree.
In fact, unstaked nodes tend to be “last” in the fan-out of block broadcasting, which can involve tens or hundreds of additional milliseconds of delay in viewing each block.
Instead, ShredStream delivers the block fragments as they are generated. There is no waiting for the block to be complete; The client receives each portion instantly. This means that by the time a normal RPC notifies a new block or transaction, a ShredStream client may have already received (and reconstructed) that block an instant ago.
According to Jito Labs, using ShredStream can save hundreds of milliseconds in receiving data during high frequency trading. In competitive applications, this time difference is criticism.
A traditional RPC provides high-level data: JSON with decoded transactions, accountA data structure on Solana that holds tokens and state; acco... More statements, etc., ready to use by applications. ShredStream, for its part, provides low level data (shreds are essentially binary UDP packets with signed block data).
This data requires additional processing. In many cases, deploying ShredStream involves connecting the stream of shreds to a Solana node configured to accept them (for example, injecting them into the TVU port of the local node) and thus take advantage of the node’s internal pipeline to rebuild the block.
Alternatively, the developer must implement the shred decoding and block reconstruction logic manually, using the same Solana ledger logic – something complex and generally unnecessary if an existing node can be used.
Traditional RPC calls (HTTP JSON-RPC) are request-response or subscription via WebSocket, passing through API layers that can introduce some overhead.
ShredStream operates at the UDP network level (transport layer directly, without the overhead of HTTP/JSON) by continuously sending packets without prior request for each block.
It is, by design, a unidirectional flow of data in real time, more like subscribing to a feed internal network multicast. This allows higher throughput and lower latency, at the cost of being more specialized. For example, Helius (an infrastructure provider) exposes a gRPCgRPC es un framework de código abierto de alto rendimiento ... More on its dedicated nodes that, under the hood, uses ShredStream for maximum notification speed.
In summary, a RPC normal is easier to use and returns processed information but with a slight delay, while ShredStream provides access immediate to the Solana block creation flow, requiring greater technical complexity to interpret the data.
For most end-user applications (wallets, browsers, typical dApps), the extra latency of an RPC is tolerable and the convenience of ready data is preferable. Instead, for specialized cases (algorithmic trading, arbitrage bots, optimized validators), ShredStream offers a unique speed and priority advantage.
The bots of Maximal Extractable Value (MEV) and the sniper bots (bots that seek to execute critical transactions at the first possible moment, for example to buy tokens as soon as they go on the market or take advantage of immediate arbitrage) compete in an environment where a few tens of milliseconds can make the difference between the success or loss of an opportunity.
On Solana, these bots have emerged in force, and ShredStream plays a key role in enabling their success.
For an MEV/sniper bot, knowing what is happening on the network as soon as possible It is essential. Thanks to ShredStream, these bots can receive practically in real time each transaction that a leading validator is including in a block, before said block is widely disseminated. This allows them to detect opportunities such as:
Example, if a large trade is being executed on a DEX that will move the price, a bot with ShredStream will see that trade as soon as the leader processes it (fragmented into shreds) and can calculate an arbitrage with another DEX or market immediately, without waiting for the entire network to see the new price.
Detect in near real time that certain settlement in a DeFi protocol is occurring, allowing the transaction to be prepared to be captured in the next block (or even try to sneak into the current block if there is time).
When you list a new token any initial purchase transactions will be seen by the bot via shreds, alerting you to submit your own purchase transaction before the asset rises in price.
ShredStream gives bots a preview of Solana’s “implicit mempool.” Since Solana does not have a traditional public mempool (thanks to Gulf Stream, transactions go directly to designated leaders ), ShredStream in practice emulates that early visibility: bots listen to transactions while the block is being forged.
Without ShredStream, a bot would have to wait for the entire block to be published (via RPC/WebSocket) to react, by which time it is too late. That’s why many of the most successful bots on Solana attribute their competitive advantage to using ultra-low latency data feeds like ShredStream.
It is not enough see quickly opportunities; bots must also get their own transactions to the lead validator with the highest possible priority. The infrastructure and certain features of Solana also come into play here:
With ShredStream it usually comes with the bot or its infrastructure being directly connected to one or more staked validators.
This is important because, from 2024, Solana introduced Stake-Weighted Quality of Service (QoS). Leaders reserve 80% of their transaction input capacity for staked validator node connections, and only 20% for unstaked RPC node connections.
In practice, a bot sending its transaction from an unstaked node could suffer from more queuing or even be rejected if there is a lot of traffic, compared to sending it through a validator.
Therefore, MEV search engines often place infrastructure inside a validator (or run their own staked validator) to benefit from this prioritization on the network. Some services, such as Jito Labs and Triton, facilitate this connection: for example, Triton One mentions that its RPC nodes in trading centers are powered by highly staked validators that relay shreds to them and accept transactions, ensuring priority in the to fan of the leader.
Jito Labs, focused on MEV in Solana, developed a Block Enginecustom (Jito-Solana client) that implements an out-of-protocol block space auction. Specifically, the relay from Jito introduces an artificial wait (~200 ms) on the leader to process transactions.
During that small interval (speed bump), bots can send bundles or transactions with high tips to the Jito relayer, competing for preferential inclusion in the block.
An MEV bot with ShredStream access can detect an opportunity and, within those critical 200 ms, send its bundle to the validator (via Jito relayer) at a priority rate to ensure it will be included before competing transactions.
This is analogous to Flashbots bundles on Ethereum. An MEV bot with ShredStream access can detect an opportunity and, within those critical 200 ms, send its bundle to the validator (via Jito relayer) at a priority rate to ensure it will be included before competing transactions.
The capacity to react within that 200 ms window totally depends on having the data practically instantly (again, ShredStream) and having the mechanism for fast sending to the relayer/leader already prepared.
Even outside of Jito, Solana now allows additional fees to be attached to transactions to influence their priority. A sniper bot usually calculates an optimal tip (share) to make your transaction attractive to the leader (highest priority) without overpaying. ShredStream’s early information helps you decide this dynamically (for example, if you see a lot of transactions coming in, maybe increase your feeA small cost associated with processing a transaction; fees ... More to stand out).
In summary, ShredStream amplifies the effectiveness of MEV/sniper bots when pairing the early vision of what happens on the network with the ability to act first. Those bots that use ShredStream usually also invest in optimized network connections (direct peering with validators, use of Jito relays, etc.) so that their response transaction reaches the block on time and with priority. This can mean the difference between capturing an MEV opportunity or losing it to another, faster player.
Although ShredStream provides data as quickly as possible, the effective latency What a bot or app experiences depends on several additional factors. Among the most important are:
As mentioned, physical proximity to the data source reduces propagation latency. If the ShredStream feed comes from a leading validator in New York (NY) and our server is in Asia, the signal takes tens of milliseconds longer to reach than another server on the US East Coast.
Jito Labs recognizes this point by offering specific regions (ex: NY, Amsterdam, all of them are on our discord server) to receive shreds, and suggests deploying proxies in each relevant region.
Location |
Jito IPs |
---|---|
🇳🇱 Amsterdam |
74.118.140.240, 64.130.52.138, 202.8.8.177, 64.130.55.26, 64.130.55.174, 64.130.55.28 |
🇩🇪 Frankfurt |
64.130.50.14, 64.130.57.199, 64.130.57.99, 64.130.57.171, 64.130.40.23, 64.130.40.22, 64.130.40.21 |
🇺🇸 New York |
141.98.216.96, 64.130.51.137, 64.130.51.41, 64.130.59.205, 64.130.34.189, 64.130.34.190, 64.130.34.141, 64.130.34.142 |
🇺🇸 Salt Lake City |
64.130.53.88, 64.130.53.90, 64.130.53.82 |
🇯🇵 Tokyo |
202.8.9.160, 202.8.9.22, 208.91.107.252, 64.130.49.142 |
In practice, many choose strategic data centers where clusters of validators reside. The intercontinental latency it can be ~100ms or more, while within the same region it can be <5ms. Therefore, placement is critical: a bot with ShredStream in the wrong place could see much of its advantage eroded.
Performance of the receiving node (RPC/local validator)
If we are passing the shreds to a local Solana node (our RPC), the speed at which that node processes and assembles the block counts.
An undersized node (slow CPU, slow disk, etc.) could become a bottleneck, diluting the gain of getting shreds early. Ideally, the RPC node should have sufficient resources to process each shred immediately and prepare the block in memory.
In conclusion, ShredStream minimizes the data fetch latency, but achieving a truly ultra-fast experience requires optimizing the bot’s entire environment: from where it’s hosted to how it processes each byte. The total latency It is the sum of many factors, and elite bots take care of every millisecond in every step.
Bottom line:
Use ShredStream only when sub-second reaction times are a must. For everything else, a good RPC (even a premium one with fast WebSockets) delivers the right balance of performance and ease.
ShredStream represents a crucial innovation at Solana to access data on-chain with the lowest possible latency. Unlike traditional RPC APIs, which deliver information with a slight delay and in a processed format, ShredStream opens a direct window into the block generation process, providing bots and automated systems the ability to see and react to events before anyone else. This has been instrumental in the emergence of successful MEV and sniper bots on Solana, which combine ShredStream with network optimizations, transaction prioritization, and accelerated execution to exploit split-second opportunities.
However, this technical advantage comes with complexity and cost, so its implementation is justified only in specific cases of high time requirement. In other scenarios, solutions such as RPCs with Geyser (for example Helius) or data streams such as Firehose/Substreams offer middle points on the spectrum between latency, ease of use and data coverage. Each team must evaluate its needs: whether the strategy or application depends on the extreme speed, ShredStream or equivalent services will be part of the stack; Otherwise, a good old-fashioned RPC or standard stream will be more than enough.
In short, ShredStream plays the role of “accelerator” in the Solana ecosystem, pushing the limits of what is possible in algorithmic trading and real-time operations. In combination with other developments (such as Jito block auction, stake-weighted QoS, etc.), it is transforming the way value is captured on Solana, enabling use cases “only possible on Solana” thanks to its performance. Those looking to build the fastest bot infrastructure will need to understand and take advantage of ShredStream, while the rest of the community can watch as these performance improvements eventually translate into a more efficient and service-rich network.
Engineer. CEO of GS Node. Marketing Manager at Smithii.