LIVE · cybersecurity feed
Live wire
AI found more critical bugs in another widely used technology running 225M websitesCognizant and Qualys Redefine AI-Era Managed Security ServiceJava4Shell Vulnerability Allows Remote Attacks on Major Java AppsCVE-2026-114938 · Java4Shell (CVE-2026-114938): Frequently asked questions about OpenJDK remote code execution vulnerabilityCVE-2026-114938 · CVE-2026-114938: Critical vulnerability in OpenJDK JAVACritical Java4Shell flaw allows RCE attacks on major Java applicationsCVE-2026-114938 · How to Find, Mitigate, and Patch the Critical Java4Shell Flaw (CVE-2026-114938) NowCVE-2026-28160 · e4jvikwp VikRentCar Vulnerability Listed As Exploited In VulnCheck KEVCVE-2025-5569 · Ideacms Improper Neutralization Flaw Added To VulnCheck KEV After 514 DaysCVE-2025-41452 · Danfoss AK-SM8xxA Series Vulnerability Added To VulnCheck KEV
patch

Dagster: Open-source cloud-native data pipeline orchestrator

Dagster, an open-source data pipeline orchestrator designed for cloud-native environments, provides a framework for managing the execution, scheduling, and lineage of data assets. The platform functions by determining the sequence and timing of data processing tasks while tracking the relationships between various datasets, machine learning models, and reports. By mapping these connections,…

ZeroDay News ·

Source: Help Net Security

Dagster, an open-source data pipeline orchestrator designed for cloud-native environments, provides a framework for managing the execution, scheduling, and lineage of data assets. The platform functions by determining the sequence and timing of data processing tasks while tracking the relationships between various datasets, machine learning models, and reports. By mapping these connections, the software allows users to visualize how data flows through a system, which facilitates the identification of downstream impacts when a specific data source encounters an error.

The core architecture of Dagster relies on the definition of data assets, which are implemented as Python functions marked with the @dg.asset decorator. Developers define dependencies by naming assets within these function parameters, allowing the system to automatically construct a dependency graph that is rendered in a web-based user interface. This approach enables the chaining of complex data operations, such as combining raw population figures with statistical models to generate aggregate reports.

Installation of the platform is managed through a single command, supporting Python versions ranging from 3.9 through 3.14. The project maintains a library of integrations for common data tools, including dbt, which allows teams to incorporate existing data quality tests directly into the Dagster workflow. These tests, referred to as asset checks, are written in code alongside the assets they monitor. For example, a check might be configured to verify that a specific column contains no null values.

A significant feature of the platform is the ability to designate asset checks as blocking. When a check is marked in this manner, the system will prevent the materialization of any downstream assets if the check fails. This mechanism is intended to ensure that corrupted or incomplete data does not propagate through the pipeline to affect subsequent tables or models. These checks can be executed automatically using defined schedules and sensors.

Dagster also provides functionality for handling data partitions, which allow assets to be divided into distinct slices, such as daily intervals. When data is missing or requires reconstruction, the system facilitates backfills to process these slices. By default, the orchestrator initiates a separate run for each partition, though users can implement backfill policies to consolidate these tasks into a single operation, such as a unified query in Snowflake.

While the system records each partition as filled regardless of the execution method, it is important to note that these backfill policies are only applied when the process is initiated from the asset graph or an asset page. Backfills started through a job page do not adhere to these specific policies. The software remains available for deployment via its public GitHub repository, providing teams with a centralized tool for monitoring data quality and pipeline health.

patchcloud
ShareXLinkedInWhatsAppFacebook

More News

view all →
vulnerabilitycritical

AI found more critical bugs in another widely used technology running 225M websites

F5 has issued an emergency security update for the open-source NGINX web server to address 10 newly discovered vulnerabilities. These flaws affect a significant portion of the internet, as NGINX currently powers approximately 225 million websites. The vendor has urged all administrators to upgrade their systems to version 1.31.9 immediately to mitigate the risks.

vulnerability

Consensus mounts that tech outages were fueled by patching of AI-discovered vulnerabilities

A series of significant technical outages affecting aviation, banking, and communications infrastructure over the past week has prompted a federal investigation into the stability of critical systems. While initial concerns focused on the possibility of coordinated cyberattacks, officials from the Trump administration, including Secretary of Homeland Security Markwayne Mullin, Director of…

ai

Coinbase blocks $4.7 million in transfers to Elon Musk deepfake scam

Coinbase successfully intercepted $4.7 million in cryptocurrency transfers associated with a sophisticated deepfake scam targeting users during a high-profile Tesla event. The incident occurred during a demonstration of Tesla's flying car technology, which was broadcast via a fraudulent YouTube livestream. The stream, which drew an audience of over 500,000 viewers, utilized AI-generated video…

ai

Strike Graph Launches Integration AI to Automate Continuous Compliance Evidence Using Any Existing Tool

Strike Graph has announced the launch of a new agentic AI solution designed to automate the collection of compliance evidence across an organization’s existing software stack. By leveraging direct API integrations, the platform aims to streamline the evidence-gathering process, mapping data points to more than 30 different compliance frameworks simultaneously to eliminate redundant manual…

nation-state

California tells Waymo to take the next exit after freeway mishaps

Waymo has suspended all driverless operations on high-speed freeways across the United States following regulatory intervention in California. The Alphabet-owned company initiated this nationwide pause on November 11, the same day the California Department of Motor Vehicles (DMV) formally banned the firm from conducting driverless freeway trips within the state. While the suspension affects…

malware

Microsoft's official Python agent framework hijacked to distribute malware

Microsoft has confirmed that its official Python agent-framework package was compromised, leading to the distribution of malicious code through the Python Package Index (PyPI). The incident involved the unauthorized upload of versions 1.26.1 and 1.26.2, which were pushed to the repository using Microsoft’s official publisher account. Security researchers identified the breach, noting that the…