Streaming on Project Wintermute

Go HTTP/2 Idle Context Cancel And Localhost Resolver

Sun, 20 Sep 2026 14:00:00 +0000

The golang/go tree put 62 commits on master in this review window, across 206 files with 5112 insertions and 1665 deletions. Compiler ports and SSA work ate most of that diff. The pieces that change how production services behave sit in net/http, the Go DNS resolver, and runtime.Pinner.

Geth Closes JSON RPC Panics And Adds Snap Sync Metrics

Tue, 15 Sep 2026 14:00:22 +0000

go-ethereum is the Go Ethereum execution client that indexers, ETL jobs, and RPC gateways still treat as the default node. Master this week landed 14 commits (30 files, 455 insertions, 46 deletions). None of this is a protocol fork. It is panic fixes on JSON RPC call paths, snap sync gauges that used to live only in logs, and a JUMPDEST cache that billed 17 bytes while holding about 186.

GoAkt 4.5.5 Cuts Grain Heap And Tightens Cluster Claims

Sun, 13 Sep 2026 14:00:16 +0000

GoAkt is a distributed actor runtime for Go. Grains are its virtual actors, activated on first message, passivated when idle, and claimed once across a cluster. This week the project shipped v4.5.4 and v4.5.5, and the code that landed is about grain density and cluster ownership, not new public APIs.

ingestr v1.1.51 - Postgres CDC Row Loss and MSSQL Stream

Thu, 10 Sep 2026 07:39:56 +0000

ingestr v1.1.51 was published on 10 September 2026. The patch contains two ingestion changes. The one that matters on a live pipeline is the PostgreSQL CDC fix: a schema rebuild keeps buffered rows for tables that stayed valid.

Prometheus v3.13.3: TSDB Compaction Stalls and Shutdown CPU

Mon, 07 Sep 2026 14:18:03 +0000

Prometheus v3.13.3 was published on 7 September 2026 as a stable patch. The change that matters on a busy node is a TSDB fix: out of order queries could block compaction for hours, and memory usage grew for as long as compaction stayed blocked.

Apache NiFi Fixes Stale Prometheus Series And S3 Path Style

Mon, 07 Sep 2026 14:00:19 +0000

Apache NiFi is the JVM flow engine that sits between queues and talks to S3, SMB, email, and the rest of the warehouse. Main took 28 commits in the past week, 175 files, 5073 insertions and 406 deletions. The operator visible work is Prometheus series that no longer linger after an instance ID change, S3 processors that no longer force path style access, and Parameter Context updates that used to fail in a cluster.

Debezium Caps Oracle LogMiner Growth And Tightens CDC Validation

Wed, 02 Sep 2026 14:00:00 +0000

Debezium is the Kafka Connect CDC engine operators run against Oracle, Postgres, MySQL, MariaDB, and MongoDB. The recorded window on main is 37 commits across 115 files, 6328 insertions and 588 deletions. No release tag landed. The pieces that change runtime behavior are Oracle LogMiner window growth, MongoDB topology checks, empty Postgres enums, and MySQL schema history recovery on large binlog files.

Apache Flink Adds UUID Type And Runtime Fixes

Tue, 01 Sep 2026 14:00:21 +0000

Apache Flink is a distributed stream and batch engine. Recent master activity on apache/flink landed 27 commits across 177 files (7599 insertions, 2161 deletions). The operator facing pieces are a new UUID Table type, native S3 writer and plugin packaging fixes, and two runtime bugs that stall watermarks or undercount checkpoint acks during failover.

Redpanda Connect v4.107.2 - DynamoDB CDC Lint And Snapshot Barriers

Mon, 31 Aug 2026 15:53:55 +0000

Redpanda Connect v4.107.2 shipped on 31 August 2026. Config lint for aws_dynamodb_cdc no longer rejects valid snapshot_throttle durations, and an expired DynamoDB shard iterator is now a permanent error instead of an infinite retry. The same tag reworks SQL Server and Oracle snapshot barriers so a failed publisher does not drop records or loop.

Polars Adds Join Reordering And SQL Coverage

Mon, 31 Aug 2026 14:00:00 +0000

Polars landed 145 commits on main between 25 August and 31 August 2026. The lazy planner now reorders inner joins using scan cardinality, SQL coverage grew for GROUP BY and DATE literals, and leftover 2.0 APIs now fail with a pointer instead of a generic AttributeError. If you collect large star queries or call pl.sql(..., eager=True), check the plan before you ship.

php-src Adds Chunked Pgsql Fetch And Memory Guards

Sun, 30 Aug 2026 14:00:17 +0000

php-src is the C implementation of the PHP language. Recent master activity put 50 commits on the board, 280 files, 5591 insertions, and 707 deletions, with NEWS and UPGRADING taking most of the file churn as PHP 8.6 notes fill in. The operator visible work is a real fetch API for large Postgres result sets, plus crash and leak fixes in streams, Phar, FPM, and the allocator.

goai v0.9.9 - Streaming Timeouts And Capability Detection

Sun, 30 Aug 2026 09:20:26 +0000

goai v0.9.9 was published on 30 August 2026. Anthropic DoGenerate now streams long running thinking requests instead of holding a silent HTTP POST open until the model finishes. Those calls were dying on idle timeouts at proxies and load balancers, not on API errors.

Redpanda Connect v4.107.1 - CDC Checkpoint And Stall Fixes

Fri, 28 Aug 2026 20:40:07 +0000

Redpanda Connect v4.107.1 shipped on 28 August 2026 as a patch for change data capture inputs. The tag closes snapshot barrier, checkpoint, and silent stall bugs that could skip rows or retry forever after a crash or a failed flush. Operators running mssqlserver_cdc or oracledb_cdc should treat this as a correctness patch, not a feature bump.

Linux Networking Correctness For Data Pipelines

Fri, 28 Aug 2026 14:00:18 +0000

The Linux kernel is the network and memory substrate beneath most ETL and streaming hosts. Its 381 commits in the review window include a concentrated set of fixes for packet reassembly, traffic control, TCP retransmission, and Ethernet driver validation. These are narrow changes, but they sit on paths where bad metadata or an unusual packet sequence can stall or corrupt a busy data flow.

mp4ff v0.56.0 - Parser Allocation Bounds

Sat, 22 Aug 2026 14:24:29 +0000

Eyevinn mp4ff v0.56.0 shipped on 22 August 2026. The Go MP4 box library now rejects out of range AVC and HEVC NAL fields that turned a few dozen bytes into multi gigabyte allocations, and hevc.ParseSliceHeader infers the Section 7.4.7.1 defaults that made x265 --no-deblock streams fail byte_alignment. The same tag adds QuickTime sound sample description versions 1 and 2, a WaveBox for the wave atom, and the labl Label box used for track labels in DASH-IF Ingest.

Apache Beam Tightens Data Connector Correctness

Sat, 22 Aug 2026 14:00:17 +0000

Apache Beam is a unified batch and streaming data processing project. Its recent activity is worth attention because 52 commits changed 198 files, with the most useful work landing at data boundaries: historical Delta reads, secret backed JDBC access, and connector failure handling. This is not a release, but several changes deserve focused tests before the next upgrade.

Redpanda Connect v4.106.0 - CDC Silent Loss Fixes

Thu, 20 Aug 2026 15:36:17 +0000

Redpanda Connect v4.106.0 was published on 20 August 2026. The tag fixes silent data loss in aws_dynamodb_cdc, cockroachdb_changefeed, and salesforce_cdc, where checkpoints could advance before downstream work was acknowledged. A full Salesforce Pub/Sub buffer now applies backpressure instead of dropping events.

ingestr v1.1.35 - CDC Table Subset Selection

Tue, 18 Aug 2026 12:29:54 +0000

ingestr v1.1.35 was published on 18 August 2026. The tag is not a prerelease. --source-table can now name a subset of CDC tables, and the run resolves that list against the discovered inventory.

circuit v4.2.0 - ForceOpen And Rolling Stats

Tue, 18 Aug 2026 10:48:11 +0000

The Go library circuit from cep21, tagged v4.2.0, was published on 18 August 2026. The release is a bug fix and performance pass over the open and half-open state machine and over rolling window statistics. The change operators will feel first is ForceOpen. It now rejects every request, including the half-open probes that previously still ran.

Cilium v1.20.1 - CIDR Policy Bypass And DSR Recovery

Tue, 18 Aug 2026 10:36:16 +0000

Cilium v1.20.1 shipped on 18 August 2026 as a stable patch on the 1.20 line, not a release candidate. The change that matters in production is a silent CIDR policy bypass, plus matching traffic drops, after an agent restart. The same tag also shortens recovery for broken TCP flows that hit a DSR-enabled Service and fixes an MCS-API CRD race when clustermesh-apiserver starts before the CRD version is installed.

Temporal Replication And Queue Health Changes

Wed, 12 Aug 2026 14:00:17 +0000

Temporal is a durable workflow orchestration platform, so changes to replication cursors, task routing, and connection ownership belong in the data engineering review queue. The 28 recent commits touch 173 files, with 6,879 insertions and 628 deletions. The useful theme is operational control: safer replication rollout, bounded streams, cleaner resource shutdown, and better backlog evidence.

Apache Spark Timestamp Precision And SQL Function Changes

Tue, 11 Aug 2026 19:51:22 +0000

Apache Spark is a distributed engine for batch, streaming, and SQL workloads. Its master branch recorded 133 commits in the review window, changing 773 files with 32,314 insertions and 2,949 deletions. The useful data engineering story is tighter timestamp precision, a broader SQL surface, and fewer blind spots during reads and failures.

Linux 7.2 Tracing Correctness Notes For Data Pipelines

Mon, 10 Aug 2026 14:00:19 +0000

Linux reached its 7.2 rc7 marker after a busy week, but the useful data engineering story sits in the tracing stack. Ring buffer invariants, ftrace synchronization, and eventfs object lifetime all received fixes that matter when kernel events feed production observability pipelines.

ingestr v1.1.18 - MySQL CDC Streaming And Iceberg Concurrency

Tue, 04 Aug 2026 07:52:42 +0000

ingestr v1.1.18, published on August 4, 2026, adds streaming support for MySQL CDC. The same release guards XA checkpoints and adjusts two Iceberg catalog concurrency paths that matter when several ingestion processes start or write at once.

Apache NiFi 2.11.0 - Kafka and Flow Upgrade Changes

Mon, 03 Aug 2026 08:51:21 +0000

Apache NiFi rel/nifi-2.11.0, published August 3, 2026, changes Kafka components to use SSL instead of PLAINTEXT as the default Security Protocol. The release also tightens versioned flow upgrades and synchronization, which matters more to operators than most of the dependency and internal cleanup among its 115 resolved issues.

Debezium Embedded Storage And Snapshot Correctness Notes

Sun, 02 Aug 2026 14:00:17 +0000

Debezium is a CDC platform for turning database changes into ordered event streams. The review window covers 77 commits and 397 changed files, but the operator facing thread is narrower. Recent work in the Debezium repository reduces Kafka coupling in the embedded engine, changes how snapshot boundaries are queried, and makes several connector contracts more explicit.

Redpanda Connect v4.103.1 - LogMiner Query Debug Logging

Fri, 31 Jul 2026 15:41:54 +0000

Redpanda Connect v4.103.1 was published on July 31, 2026. The release adds an additional debug log for LogMiner queries in the oracledb_cdc input, a narrow observability change for Oracle CDC diagnosis. It is a stable release, not a prerelease.

Cilium v1.20.0 - Gateway And Service Traffic Changes

Wed, 29 Jul 2026 15:00:29 +0000

Cilium v1.20.0 was published on July 29, 2026. The main operator change is the move from Gateway API v1.4 to v1.6.1, with broader traffic routing and backend controls for data services as well as HTTP applications.

Benthos CDC And Storage Connector Notes

Mon, 27 Jul 2026 14:00:07 +0000

Benthos is a Go stream processor used to connect data systems without adding another application service. Its latest 11 commits touch 31 files, with 803 insertions and 242 deletions, but the useful operator story is narrower: better CDC evidence, fewer storage connector edge cases, and more explicit configuration.

Python Polars 1.43.1 - Query Correctness Fixes

Mon, 27 Jul 2026 12:08:22 +0000

Python Polars 1.43.1 was published on July 27, 2026. This stable patch release concentrates on query correctness, led by fixes for a panic in self joins over Delta or Iceberg scans and undefined behavior in first/last_non_null on an empty chunk. For production data pipelines, those failure fixes matter more than the small expression optimization also included in the release.

ingestr v1.1.10 - CDC State and Streaming Metrics

Mon, 27 Jul 2026 11:30:30 +0000

ingestr v1.1.10 was published on July 27, 2026. The central operator change is stronger CDC correctness: SQL Server gains hardened CDC behavior and destination managed state, while MongoDB incremental reads receive a fix for an interval gap. This is a stable release, not a prerelease.

Go TLS And Compiler Safety Notes For Data Services

Sun, 26 Jul 2026 14:00:07 +0000

The Go project recorded 62 commits across 342 files in the review window. For engineers running Go data services, the useful signals are stricter TLS parsing, compiler correctness fixes on several targets, and more reliable coverage for selected dependencies.

Apache Spark Cache And Streaming Metadata Notes

Tue, 21 Jul 2026 14:00:07 +0000

Apache Spark had a busy week, with 108 commits on master and several changes that matter to data platform teams more than application authors. The main thread is practical: cache layout, Kafka metadata calls, Real Time Mode checkpoint cost, and catalog metadata that needs to be correct when tools read JSON output.

Python Polars 1.43.0 - Hive and Streaming Pipeline Changes

Tue, 21 Jul 2026 04:30:53 +0000

Python Polars py-1.43.0, published on July 21, 2026, makes Hive partition awareness the main operator change, with group operations and joins able to organize work around partition keys. The release also tightens streaming sinks, object storage access, and several data interchange paths. GitHub marks it as a regular release, not a prerelease.

ingestr v1.1.3 - SQL Server CDC and NATS Reliability

Mon, 20 Jul 2026 11:55:33 +0000

ingestr v1.1.3 was published on July 20, 2026. The main operator visible change is hardened SQL Server CDC ingestion. This stable release also addresses a NATS streaming EOF path and two integration test reliability issues.

Redpanda Connect v4.101.0 - CDC Isolation and Row Integrity

Fri, 17 Jul 2026 22:03:48 +0000

Redpanda Connect v4.101.0 was published on July 17, 2026. The main operational change is a Snowflake streaming check intended to prevent silent data corruption when Parquet metadata disagrees with the rows actually serialized.

Apache Beam Runner And IO Readiness Notes

Thu, 16 Jul 2026 14:00:02 +0000

Apache Beam had a busy week, with 53 commits touching 163 files and a clear focus on making runners, containers, and IO paths less fragile. The useful story is not the dependency volume by itself. It is the work around Java 21 access, Dataflow options, and connector behavior that changes what pipeline operators can trust in test and release paths.

ingestr v1.0.78 - CDC State and Streaming Mode Changes

Thu, 16 Jul 2026 07:31:13 +0000

ingestr v1.0.78 was published on July 16, 2026. The main operator facing change is stronger PostgreSQL CDC state handling, backed by added coverage for TRUNCATE events and stress cases.

Tint slog Handler Migration Notes For Data Services

Tue, 14 Jul 2026 14:00:01 +0000

lmittmann/tint had a small but useful activity burst this week: three commits, seven files changed, 139 insertions, and 33 deletions. For Go data services that use slog in workers, loaders, and admin CLIs, the main point is naming clarity around the text handler plus a fix for []byte log values.

Redpanda Connect v4.100.0 - CDC And Iceberg Fixes

Thu, 09 Jul 2026 16:57:12 +0000

Redpanda Connect v4.100.0 was published on July 9, 2026, with a useful mix of source connector work and correctness fixes for data movement. The main operator story is not volume of changes. It is that Jira ingestion, Iceberg writes, Oracle CDC, Postgres CDC, and timezone handling all received fixes that reduce quiet failure modes in pipelines.

Apache Beam v2.75.0 - Dataflow And IO Release Notes

Wed, 08 Jul 2026 06:42:25 +0000

Apache Beam v2.75.0 was published on July 8, 2026, with the main operator change around Dataflow Streaming Engine state tag encoding v2 becoming the default for new Java jobs. The release also adds Delta Lake reads, expands YAML output targets, and changes Flink runner support in ways that matter for batch and streaming pipeline owners.

Apache Spark Python UDF And SQL Operator Notes

Mon, 06 Jul 2026 14:00:02 +0000

Apache Spark had a busy week on master: 120 commits touched 457 files. The activity in apache/spark is not a release note dump; it is mostly data path cleanup around Python UDF transport, SQL correctness, security, and test determinism that affects teams running Spark as part of an ETL platform.

Redpanda Connect v4.99.0 - Iceberg and CDC Changes

Thu, 02 Jul 2026 15:11:21 +0000

Redpanda Connect v4.99.0 was published on July 2, 2026, with the largest operator impact in Iceberg output and CDC connector state. The release adds Iceberg row level insert, upsert, and delete handling, then fills gaps in DynamoDB, Oracle, and Postgres CDC metadata that matter when pipelines need replayable change history. The release is not marked as a prerelease.

Redpanda Connect v4.98.0 - CDC Recovery Fixes

Fri, 26 Jun 2026 08:39:55 +0000

Redpanda Connect v4.98.0 was published on June 26, 2026, with CDC fixes that matter for pipelines reading from DynamoDB Streams, PostgreSQL, and Oracle LogMiner. The most important change is DynamoDB Streams recovery from expired shard iterators, because that failure mode can stall a shard until a pod restart during backpressure or idle periods. It is not marked as a prerelease.

Apache NiFi 2.10.0 - Cluster and JSON Fixes

Tue, 23 Jun 2026 11:05:48 +0000

Apache NiFi 2.10.0, tag rel/nifi-2.10.0, was published on June 23, 2026. It is not marked as a prerelease, and the release notes frame it as a feature improvement and bug fix release with more than 160 issues resolved. For data pipeline operators, the useful changes sit around JSON tolerance, Flow Registry clients, Content Repository cleanup, and cluster correctness under node movement.