Skimpy

A light weight tool for creating summary statistics from dataframes.

skimpy is a light weight tool that provides summary statistics about variables in pandas or Polars data frames within the console or your interactive Python window.

Think of it as a super-charged version of pandas' df.describe(). You can find the documentation here.

Quickstart

skim a pandas or polars dataframe and produce summary statistics within the console using:

from skimpy import skim

skim(df)

where df is a pandas or polars dataframe.

If you need to a dataset to try skimpy out on, you can use the built-in test Pandas data frame:

from skimpy import generate_test_data, skim

df = generate_test_data()
skim(df)

<pre style="white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace">╭──────────────────────────────────────────────── skimpy summary ─────────────────────────────────────────────────╮ │ <span style="font-style: italic"> Data Summary </span> <span style="font-style: italic"> Data Types </span> <span style="font-style: italic"> Categories </span> │ │ ┏━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓ ┏━━━━━━━━━━━━━┳━━━━━━━┓ ┏━━━━━━━━━━━━━━━━━━━━━━━┓ │ │ ┃<span style="color: #008080; text-decoration-color: #008080; font-weight: bold"> Dataframe </span>┃<span style="color: #008080; text-decoration-color: #008080; font-weight: bold"> Values </span>┃ ┃<span style="color: #008080; text-decoration-color: #008080; font-weight: bold"> Column Type </span>┃<span style="color: #008080; text-decoration-color: #008080; font-weight: bold"> Count </span>┃ ┃<span style="color: #008080; text-decoration-color: #008080; font-weight: bold"> Categorical Variables </span>┃ │ │ ┡━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩ ┡━━━━━━━━━━━━━╇━━━━━━━┩ ┡━━━━━━━━━━━━━━━━━━━━━━━┩ │ │ │ Number of rows │ 1000 │ │ float64 │ 3 │ │ class │ │ │ │ Number of columns │ 13 │ │ category │ 2 │ │ location │ │ │ └───────────────────┴────────┘ │ datetime64 │ 2 │ └───────────────────────┘ │ │ │ object │ 2 │ │ │ │ int64 │ 1 │ │ │ │ bool │ 1 │ │ │ │ string │ 1 │ │ │ │ timedelta64 │ 1 │ │ │ └─────────────┴───────┘ │ │ <span style="font-style: italic"> number </span> │ │ ┏━━━━━━━━━┳━━━━━━┳━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━┳━━━━━━━━┓ │ │ ┃<span style="font-weight: bold"> column </span>┃<span style="font-weight: bold"> NA </span>┃<span style="font-weight: bold"> NA % </span>┃<span style="font-weight: bold"> mean </span>┃<span style="font-weight: bold"> sd </span>┃<span style="font-weight: bold"> p0 </span>┃<span style="font-weight: bold"> p25 </span>┃<span style="font-weight: bold"> p50 </span>┃<span style="font-weight: bold"> p75 </span>┃<span style="font-weight: bold"> p100 </span>┃<span style="font-weight: bold"> hist </span>┃ │ │ ┡━━━━━━━━━╇━━━━━━╇━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━╇━━━━━━━━┩ │ │ │ <span style="color: #af87ff; text-decoration-color: #af87ff">length </span> │ <span style="color: #008080; text-decoration-color: #008080"> 0</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0.5016</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0.3597</span> │ <span style="color: #008080; text-decoration-color: #008080"> 1.573e-06</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0.134</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0.4976</span> │ <span style="color: #008080; text-decoration-color: #008080">0.8602</span> │ <span style="color: #008080; text-decoration-color: #008080"> 1</span> │ <span style="color: #008000; text-decoration-color: #008000">█▃▃▃▄█</span> │ │ │ │ <span style="color: #af87ff; text-decoration-color: #af87ff">width </span> │ <span style="color: #008080; text-decoration-color: #008080"> 0</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0</span> │ <span style="color: #008080; text-decoration-color: #008080"> 2.037</span> │ <span style="color: #008080; text-decoration-color: #008080"> 1.929</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0.002057</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0.603</span> │ <span style="color: #008080; text-decoration-color: #008080"> 1.468</span> │ <span style="color: #008080; text-decoration-color: #008080"> 2.953</span> │ <span style="color: #008080; text-decoration-color: #008080">13.91</span> │ <span style="color: #008000; text-decoration-color: #008000"> █▃▁ </span> │ │ │ │ <span style="color: #af87ff; text-decoration-color: #af87ff">depth </span> │ <span style="color: #008080; text-decoration-color: #008080"> 0</span> │ <span style="color: #008080; text-decoration-color: #008080"> 0</span> │ <span style="color: #008080; text-decoration-color: #008080"> 10.02</span> │ <span style="color: #008080; text-decoration-color: #008080"> 3.208</span> │ <span style="color: #008080; text-decoration-color: #008080"> 2</span> │ <span style="color: #008080; text-decoration-color: #008080"> 8</span> │ <span style="color: #008080; text-decoration-color: #008080"> 10</span> │ <span style="color: #008080; text-decoration-color: #008080"> 12</span> │ <span style="color: #008080; text-decoration-color: #008080"> 20</span> │ <span style="color: #008000; text-decoration-color: #008000">▁▄█▆▃▁</span> │ │ │ │ <span style="color: #af87ff; text-decoration-color: #af87ff">rnd </span> │ <span style="color: #008080; text-decoration-color: #008080"> 118</span> │ <span style="color: #008080; text-decoration-color: #008080"> 11.8</span> │ <span style="color: #008080; text-decoration-color: #008080"> -0.01977</span> │ <span style="color: #008080; text-decoration-color: #008080"> 1.002</span> │ <span style="color: #008080; text-decoration-color: #008080"> -2.809</span> │ <span style="color: #008080; text-decoration-color: #008080">-0.7355</span> │ <span style="color: #008080; text-decoration-color: #008080">-0.0007736</span> │ <span style="color: #008080; text-decoration-color: #008080">0.6639</span> │ <span style="color: #008080; text-decoration-color: #008080">3.717</span> │ <span style="color: #008000; text-decoration-color: #008000">▁▄█▅▁ </span> │ │ │ └─────────┴──────┴───────┴───────────┴─────────┴────────────┴─────────┴────────────┴────────┴───────┴────────┘ │ │ <span style="font-style: italic"> category </span> │ │ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┓ │ │ ┃<span style="font-weight: bold"> column </span>┃<span style="font-weight: bold"> NA </span>┃<span style="font-weight: bold"> NA % </span>┃<span style="font-weight: bold"> ordered </span>┃<span style="font-weight: bold"> unique </span>┃ │ │ ┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━