Skip to content

feat: add DataFusionFormatter#9338

Merged
mchav merged 4 commits into
marimo-team:mainfrom
mchav:datafusion
Apr 23, 2026
Merged

feat: add DataFusionFormatter#9338
mchav merged 4 commits into
marimo-team:mainfrom
mchav:datafusion

Conversation

@mchav

@mchav mchav commented Apr 23, 2026

Copy link
Copy Markdown
Contributor

📝 Summary

Datafusion previously didn't have a formatter so showing the dataframe was undefined (blank on local, an error on molab).

Closes #9337

📋 Pre-Review Checklist

  • For large changes, or changes that affect the public API: this change was discussed or approved through an issue, on Discord, or the community discussions (Please provide a link if applicable).
  • Any AI generated code has been reviewed line-by-line by the human PR author, who stands by it.
  • Video or media evidence is provided for any visual changes (optional).

✅ Merge Checklist

  • I have read the contributor guidelines.
  • Documentation has been updated where applicable, including docstrings for API changes.
  • Tests have been added for the changes made.

@vercel

vercel Bot commented Apr 23, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
marimo-docs Ready Ready Preview, Comment Apr 23, 2026 3:11pm

Request Review

@mchav mchav added the bug Something isn't working label Apr 23, 2026
@mchav mchav requested a review from Light2Dark April 23, 2026 06:27
@mchav

mchav commented Apr 23, 2026

Copy link
Copy Markdown
Contributor Author
Screenshot 2026-04-22 at 11 25 39 PM

@Light2Dark Light2Dark left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would you want to add tests? Under test_formatters

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds first-class formatting support for Apache DataFusion DataFrame objects so they render deterministically in marimo (instead of blank/erroring), aligning DataFusion with other supported dataframe engines.

Changes:

  • Introduces DataFusionFormatter with an opinionated formatter that renders via marimo’s interactive table.
  • Registers DataFusionFormatter in the third-party formatter factory map so it activates when datafusion is imported.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
marimo/_output/formatters/formatters.py Registers the new DataFusion formatter factory for import-time activation.
marimo/_output/formatters/df_formatters.py Implements DataFusionFormatter using Arrow conversion + table(...) rendering with fallback logging.

Comment thread marimo/_output/formatters/df_formatters.py
Comment thread marimo/_output/formatters/df_formatters.py Outdated
mchav and others added 2 commits April 23, 2026 07:50
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@mchav mchav merged commit 81d7ec2 into marimo-team:main Apr 23, 2026
41 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

datafusion dataframes don't show

3 participants