Data Processing Command-Line Tools

33 tools in the Data category: data processing and transformation tools. Sorted by GitHub stars; the most starred are pandoc, jq and fx.

Tools

pandoc

pandoc

Haskell library and command-line tool that converts documents between dozens of markup formats, including Markdown, LaTeX, HTML, docx, EPUB and PDF.

46.7kHaskell
jq

jq

Command-line JSON processor for slicing, filtering, mapping and transforming structured data

36.0kC
fx

fx

Terminal-based JSON processor and viewer for querying, filtering, and manipulating JSON data interactively.

20.7kGo

yq

Command-line YAML, JSON, XML, and CSV processor with jq-like syntax for querying and transforming structured data

16.2kGo

gron

Transforms JSON into discrete assignments to make it greppable and enable exploration of complex JSON structures

14.5kGo
pgcli

pgcli

Interactive PostgreSQL client with auto-completion, syntax highlighting, and smart context-sensitive suggestions.

13.4kPython
mycli

mycli

MySQL command line client with auto-completion, syntax highlighting, and smart context-aware SQL suggestions

12.0kPython

xsv

Command line CSV data manipulation tool for indexing, slicing, analyzing, splitting and joining CSV files

10.8kRust

fq

Binary data analysis tool with jq-like query language for formats like MP4, PCAP, ELF, and packet captures

10.6k
usql

usql

Universal command-line SQL client with PostgreSQL psql-inspired interface for multiple databases

10.2kGo
miller

miller

Command-line data processing tool for CSV, TSV, JSON, and JSON Lines with field-based operations

10.1kGo
visidata

visidata

Terminal interface for exploring and arranging tabular data with support for CSV, JSON, SQLite, Excel, and many other formats.

9.4kPython

jc

Converts output of CLI tools, file types, and strings to JSON or Python dictionaries so it can be piped to jq and used in scripts.

8.7kPython

pup

Command line HTML processing tool using CSS selectors to filter and extract data from HTML documents

8.4kGo
dasel

dasel

Command-line tool for querying, modifying, and transforming structured data files (JSON, YAML, TOML, XML, CSV)

8.1kGo

htmlq

HTML parser that uses CSS selectors to extract content from HTML files, similar to jq for JSON

7.6kRust

jid

Interactive JSON explorer that takes piped input and lets you drill down with dot-path or JMESPath queries, with tab completion and suggestions.

7.2kGo

jnv

Interactive terminal JSON viewer and jq filter editor with auto-completion, using the built-in jaq engine; reads files or stdin.

6.1kRust
jless

jless

Command-line JSON viewer with syntax highlighting, collapsible sections, and vim-inspired navigation commands

5.5kRust
youplot

youplot

Command-line tool that generates Unicode plots from CSV/TSV data directly in the terminal

4.9kRuby
jo

jo

Command-line utility to create JSON objects and arrays from shell arguments and piped input

4.9kC

lazysql

Cross-platform TUI database management tool for MySQL, PostgreSQL, SQLite, and MSSQL with SQL editor and table operations.

4.4kGo

csvlens

Terminal CSV file viewer with spreadsheet-like navigation and filtering capabilities

4.0k
qsv

qsv

Rust CLI toolkit of composable commands for querying, transforming, validating, joining, and describing CSV, Excel, and other tabular data.

3.8kRust

gojq

Pure Go implementation of jq command-line JSON processor with arbitrary-precision arithmetic and YAML support

3.8kGo

angle-grinder

Command-line log analysis tool that parses, filters, and aggregates log data with a pipeline query language and a live-updating terminal UI.

3.8kRust

litecli

Command-line client for SQLite databases with auto-completion and syntax highlighting.

3.3kPython
dblab

dblab

Interactive terminal-based database client for PostgreSQL, MySQL, SQLite3, Oracle, and SQL Server

3.2k
jqp

jqp

A terminal UI for running jq queries interactively against JSON or NDJSON input, using the gojq implementation, with themes and query history.

2.9kGo

dolphie

Real-time terminal interface for monitoring MySQL/MariaDB and ProxySQL database performance and analytics

1.2kPython

daff

Library for comparing tables and producing diffs, with CLI for CSV/TSV/SQLite and git integration

932

qo

TUI for querying JSON and CSV files with SQL syntax, reads from stdin and outputs to stdout

400Go

alphai-tui

Terminal stock dashboard with watchlists, candlestick charts, portfolio tracking, news, and company filings.

88Rust

Guides