Source: https://eisoptric.com/lilith
中文: https://eisoptric.com/zh/lilith.md
Built: 2026-11-20

Lilith · Models

# Lilith 

Small language models, trained from scratch and released with every step of their training, so that how they learn can be studied rather than guessed.

**In preparation:** No Lilith model has been trained or released yet. This page describes what we are building.

> She uttered the Ineffable Name and flew away into the air.

— After the Alphabet of Ben Sira

## The name.

> כשברא הקב״ה אדם הראשון יחיד, אמר לא טוב היות האדם לבדו, ברא לו אשה מן האדמה כמוהו וקראה לילית, מיד התחילו מתגרין זה בזה … אמרה לו שנינו שוין לפי ששנינו מאדמה, ולא היו שומעין זה לזה, כיון שראתה לילית אמרה שם המפורש ופרחה באויר העולם, עמד אדם בתפלה לפני קונו ואמר, רבש״ע אשה שנתת לי ברחה ממני, מיד שגר הקב״ה שלשה מלאכים הללו אחריה להחזירה … עזבו אותה והלכו אחריה והשיגוה בתוך הים במים עזים שעתידין המצריים לטבוע בו וספרוה דבר ה' ולא רצתה לחזור …

[The Alphabet of Ben Sira, from Otzar Midrashim (New York, 1915), in the original Hebrew](https://www.sefaria.org/Otzar_Midrashim%2C_The_Aleph_Bet_of_ben_Sira%2C_The_Alphabet_of_ben_Sira%2C_(alternative_version).34)

## Lilith and the Lilim.

We borrow the image, not the belief. A model learns from its data something nobody wrote down, and it acts on what it learned. Lilith is the model that knows a hidden name. Eisoptric’s work is to learn that name, and to keep what the model does within rules people set.

One main line, and smaller siblings built for controlled comparison.

### Lilith

The main line: language models we pretrain from scratch, with training kept simple enough to repeat.

### Lilim

Named after Lilith’s children in later tradition: smaller siblings of each Lilith model, varying one thing at a time (size, seed or data order) so that one change can be compared against another.

## What each model will come with.

-   I
    
    ### Every checkpoint
    
    Saved densely through training, and most densely early on, where many capabilities first appear.
    
-   II
    
    ### The exact data order
    
    Which tokens the model saw at each step, so a change in behaviour can be traced back to what it was learning from.
    
-   III
    
    ### Code and configuration
    
    The training code, hyperparameters and environment: enough to train the same model again.
    
-   IV
    
    ### Notes
    
    What we measured along the way: evaluations across checkpoints, the probes we ran, and what did not work.
    

## Why small.

Lilith will not be a frontier model, and is not meant to be. A small model can be trained many times, inspected at every step, and compared under one controlled change at a time.

That is what studying how models learn requires, and it is what frontier-scale training cannot offer.

## Follow Lilith from the first checkpoint.

Training runs, releases and notes will be announced on GitHub.

[Eisoptric on GitHub](https://github.com/Eisoptric) [Contact us](mailto:hello@eisoptric.com)
