Skip to content

Framework

pandas

Open-source Python library providing DataFrame data structures and tools for data manipulation, cleaning, and analysis.

Known aliases

  • pandas shift
  • pandas to_json
  • pd
  • shift(1)

Current stories

buildOne report1 publisher

A Spark benchmark's Arrow UDF row toggled a setting that never touches UDFs

A Spark benchmark's "Arrow" UDF row ran the pickle path, so its 48.9x against 48.5x tie says nothing about Arrow transport. The same benchmark's useArrow=True UDFs ran about 2x faster than the plain ones.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+8
Incentives
Not scored
Confidence62
buildOne report1 publisher

PySpark's Arrow paths became defaults in Spark 4.2 after a ticket filed in 2016

Spark 4.2 makes the Arrow paths PySpark's defaults, according to a dev.to history of how the format reached each JVM-to-Python boundary. Teams upgrading get that serialization without opting in, so jobs with UDFs and pandas conversions need a test run first.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence58
buildOne report1 publisher

In one author's tests, the JIT in a uv-built Python 3.15.0 was off by default; turned on, it sped up a parsing loop 7-8% and a pandas apply 3-4%

Python 3.15.0, released October 9, 2026, ships a JIT that What's New puts at 7-8% on x86-64 Linux and 11-12% on AArch64 macOS. One data-team test on a shared Debian VM reproduced that band only for a pure-Python loop.

Publishers:dev.to

Reality

Evidence50
Adoption
Not scored
Hype gap−10
Incentives
Not scored
Confidence55
buildOne report1 publisher

Flowise deleted its CSV Agent after the regex guarding model-written code failed repeatedly

Flowise fixed a CVSS 9.8 remote-code bug in its CSV Agent with a stricter regex, then saw that filter fail through five more CVEs. It deleted the feature in June, and the patch history is a case against trusting a string filter to vet model-written code.

Publishers:dev.to

Reality

Evidence64
Adoption
Not scored
Hype gap−5
Incentives25
Confidence60
buildOne report1 publisher

Snorkel AI's LibraryDesignBench grades agent-written libraries by the code other agents write with them

Snorkel AI's LibraryDesignBench puts the best agent-designed library run at 48.9, ahead of 46.6 for human-written production libraries. Because the score also pays for shorter downstream code, the lead measures how easily other agents could use each interface.

Publishers:runtimewire.com

Reality

Evidence45
Adoption
Not scored
Hype gap+10
Incentives60
Confidence40
productConfirmed3 publishers

Databricks buys Row Zero to give Genie users a billion-row spreadsheet

Databricks bought Row Zero, whose spreadsheets hold up to 1 billion rows, to give its Genie AI assistant a grid interface. Row Zero co-founder Nick End says people still need a familiar interface to check the results AI agents produce.

Perspective Coverage

3 publishers
Builder
Builder 32%
Operator
Operator 33%
Investor
Investor 35%

Reality

Evidence62
Adoption22
Hype gap+20
Incentives70
Confidence65
buildOne report1 publisher

A five-column CSV per institution collapses 107 official rate publishers into one dataset

The AllRates dataset on Hugging Face holds 14.6 million rows in each publisher's own direction and label, so the collecting is finished while the inversion, rounding and missing-day rules stay in your code.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+12
Incentives72
Confidence50
buildOne report1 publisher

Polars 2.0 routes every lazy collect() through the streaming engine by default

Ritchie Vink is selling 2.0 as a boring upgrade. Mostly it is, but engine="auto" now resolves to streaming by default, so joins and group_bys stop carrying incidental row order, and pipelines that leaned on it will drift quietly.

Publishers:runtimewire.com

Reality

Evidence62
Adoption20
Hype gap+10
Incentives78
Confidence58
buildOne report1 publisher

Pytest catches the pipeline bugs that ship as wrong numbers

A dev.to crash course splits pipeline testing into code correctness and data correctness. The split earns its keep because a renamed column produces nulls rather than a stack trace, so nothing pages anyone.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+12
Incentives22
Confidence52
buildOne report1 publisher

LLM evals are a Cartesian sweep, and the sweep layer was solved in 2015

A dev.to post argues the cases-by-models-by-prompt-variants grid is ordinary parameter-sweep work, and that only traces and span debugging justify a vendor bill. The arithmetic backs it.

Publishers:dev.to

Reality

Evidence42
Adoption
Not scored
Hype gap+24
Incentives55
Confidence46
buildOne report1 publisher

A 192-row intent dataset with a DOI is worth more than your bigger one without

TekPedal's Turkish EV charging intent set is small enough that one wrong test prediction moves accuracy 3.1 points. It is also citable, licensed and split, which most in-house intent data is not.

Publishers:dev.to

Reality

Evidence46
Adoption10
Hype gap+8
Incentives66
Confidence52
buildOne report1 publisher

Correlation gates pass a singular design matrix, and widen the dependency to quieten them further

A 10,000-row example where x3 = x1 + x2 clears every pairwise threshold while the design matrix is singular. Split the same total across five parts and the loudest cell drops to 0.45.

Publishers:dev.to

Reality

Evidence71
Adoption
Not scored
Hype gap+6
Incentives22
Confidence64
buildOne report1 publisher

Lookahead bias passes code review because it improves the metrics. Test the clock, not the output

A developer building a pairs-trading backtest found two of his own plans disagreeing on how many times to shift a series. His fix was a test that fires a price spike into the future.

Publishers:dev.to

Reality

Evidence56
Adoption11
Hype gap+9
Incentives24
Confidence52
buildOne report1 publisher

A 20-digit ID went into a JSON repair tool and a different number came out

A team that sells precision guardrails found its own browser pages calling JSON.parse directly, rounding a snowflake ID by 1,788 with no error. The server path was safe. The client path was not.

Publishers:dev.to

Reality

Evidence60
Adoption14
Hype gap+6
Incentives68
Confidence57
buildOne report1 publisher

Before you spend quota on an agent skill, make it pass an eval harness

A Google AI series on dev.to shows how Inspect AI turns "is this MCP server worth my tokens" into a measured question, using a cheap grader model and three runs per test.

Publishers:dev.to

Reality

Evidence30
Adoption15
Hype gap+18
Incentives78
Confidence38
buildOne report1 publisher

The argmax layer was doing more work than anyone credited

A procurement team swapped a trained classifier for an LLM to pick one cost centre out of thousands. The talk transcript reads as a list of the boundaries you have to rebuild by hand.

Publishers:infoq.com

Reality

Evidence34
Adoption17
Hype gap+6
Incentives38
Confidence42
buildOne report1 publisher

Jinja Is Four Jobs In One Costume, And Only One Of Them Needs A Template

Interlace drops templating from its dbt-style models. Its argument: parse the SQL, and the dependency graph you were asked to declare twice is already sitting in the FROM clause.

Publishers:dev.to

Reality

Evidence30
Adoption
Not scored
Hype gap+20
Incentives72
Confidence36