BrainTrust Investment Lab › Band 1 — Extraction (Remote Sources → Local System)
✗ SS1 HALTED — rank 17
pbs step 5 FAILEDp.433 -- content and relationships, in the SOURCE — RuntimeError: `pbs`'s natural_key does not resolve to bare columns of `pbs_story_class`. …
✗ SS1 HALTED — rank 49
edgar_docs step 5 FAILEDp.433 -- content and relationships, in the SOURCE — MemoryError: …
✗ SS1 HALTED — rank 23
aapb step 5Now (2026-10-25 09:20, OWED): 113527 table(s) had two EQUALLY good provider surfaces offered and `aapb` declares nothing that separates them. …
What tripped it (2026-10-16 04:28): p.433 -- content and relationships, in the SOURCE — AttributeError: 'dict' object has no attribute 'lower'
… and 6 more.
The walk stops here: the next rank is not released until this is answered.
Band 1 — Extraction (Remote Sources → Local System) · book 450-451 (station) - 433, 436-437 (method) - 501 (hierarchies) · grain: one source per walk sheet
Most shops profile a sample and hope. Here, no source earns a row in the warehouse until its every value has been measured wall-to-wall — nulls, extremes, cardinality, key integrity — on instruments that can fail and say so. The flaws we find are named and written down, not discovered by Campers later.
completed
12 of 48
running now
sec_cik
tables profiled
264
rows measured
2.54B
completedrunningawaiting its turn · owedfailedexcluded
sec_cik↻rank 1 · walking · 13 step(s) certified
security_master↻rank 2 · walking · 13 step(s) certified
prices↻rank 3 · walking · 13 step(s) certified
edgar_filings↻rank 4 · walking · 13 step(s) certified
companyfacts↻rank 5 · walking · 13 step(s) certified
submissions↻rank 6 · walking · 13 step(s) certified
overview↻rank 7 · walking · 13 step(s) certified
form345↻rank 8 · walking · 13 step(s) certified
fsds↻rank 9 · walking · 13 step(s) certified
ftd↻rank 10 · walking · 13 step(s) certified
finra_short↻rank 11 · walking · 13 step(s) certified
sec_name_cik↻rank 12 · walking · 13 step(s) certified
notes↻rank 13 · walking · 13 step(s) certified
frames↻rank 14 · walking · 13 step(s) certified
fred↻rank 15 · walking · 13 step(s) certified
wayback↻rank 16 · walking · 7 certified · 6 owed
pbs↻rank 17 · walking · 4 certified · 8 owed
wikipedia↻rank 18 · walking · 3 certified · 10 owed
edgar↻rank 19 · walking · 3 certified · 8 owed
av_transcripts↻rank 20 · walking · 13 step(s) certified
shred_8k↻rank 21 · walking · 13 step(s) certified
shred_13dg↻rank 22 · walking · 13 step(s) certified
aapb↻rank 23 · walking · 4 certified · 9 owed
bdc✓rank 24 · certified · closed · 13 step(s)
crowdfunding✓rank 25 · certified · closed · 13 step(s)
form13f✓rank 26 · certified · closed · 13 step(s)
formd✓rank 27 · certified · closed · 13 step(s)
market_structure✓rank 28 · certified · closed · 13 step(s)
mfp_rr✓rank 29 · certified · closed · 13 step(s)
ncen✓rank 30 · certified · closed · 13 step(s)
nmfp✓rank 31 · certified · closed · 13 step(s)
nport↻rank 32 · walking · 13 step(s) certified
rega✓rank 33 · certified · closed · 13 step(s)
sec_enforcement↻rank 34 · walking · 6 certified · 7 owed
sec_filings_stats↻rank 35 · walking · 13 step(s) certified
sec_registries↻rank 36 · walking · 4 certified · 9 owed
transfer_agent✓rank 37 · certified · closed · 13 step(s)
vip✓rank 38 · certified · closed · 13 step(s)
fomc_text↻rank 39 · walking · 6 certified · 7 owed
lda_lobbyingrank 40 · excluded
av_options↻rank 41 · walking · 13 step(s) certified
wikidata✓rank 42 · certified · closed · 3 step(s)
dividends↻rank 43 · walking · 13 step(s) certified
splits↻rank 44 · walking · 13 step(s) certified
gdelt↻rank 45 · walking · 3 certified · 10 owed
usaspending↻rank 46 · walking · 3 certified · 10 owed
finra_regsho↻rank 47 · walking · 3 certified · 10 owed
edgar_logs↻rank 48 · walking · 1 certified · 3 owed
edgar_docs↻rank 49 · walking · 4 certified · 9 owed
The contract — what each step must produce
| # | step | page | what the book requires |
|---|---|---|---|
| 2 | IDENTIFY: the lane exists in the register | p.450-451 | "As soon as a candidate data source is identified, a light profiling assessment should be made" -- the trigger is IDENTIFICATION, not landing |
| 3 | LIGHT STRATEGIC ASSESSMENT (captures + shelf + cards) | p.450 | "a light profiling assessment ... to determine its suitability for inclusion in the data warehouse and provide an early go/no go decision" |
| 4 | REVIEWING RESULTS | p.450-451 | "provide an early go/no go decision ... Early disqualification of a data source is a responsible step" |
| 5 | TACTICAL PROFILE of a live provider sample | p.451, 502 | "a lengthy tactical data profiling effort should occur to squeeze out as many problems as possible" -- and p.502 states WHAT IT MUST CONTAIN: "Source… |
| 6 | MEASURE THE PROVIDER, NOT ITS DOCS | p.433 | "explore the actual content and relationships in the source system rather than relying on perhaps incomplete or outdated documentation" |
| 7 | THE FLAW LIST + THE CONVERSION BURDEN | p.433 | "verify the data exists in a usable state, or at least its flaws can be managed, and understand what it takes to convert it into the dimensional… |
| 8 | CANDIDATE FACTS: counts and amounts | p.437 | "identifies the counts and amounts generated by the measurement event's source system" |
| 9 | HIERARCHY VERDICT | p.501 | "investigate whether hierarchical relationships in the dimension data are perfectly clean ... either clean it up or acknowledge that it is not a… |
| 10 | THE DECLARATIONS -- the walk's real product | p.451 | "detailed specifications that are either 1) sent back to the originator ... or 2) form requirements for the data quality processing described in… |
| 11 | THE EXPECTATION NOTE TO BRAINTRUST STAFF | p.451 | "set the business sponsors' expectations regarding realistic development schedules, limitations in the source data, and the need to invest in better… |
| 12 | THE WALK IS REPEATABLE | p.436 | "Ongoing analyses of the source system and systematic data profiling during the design sessions" -- SS1 is not a one-time gate |
| 14 | THE LANDING (blocked until step 9's SIGN) | p.421 (Develop Physical Database Model, under the Physical Design heading on p.420) | "There are several additional sets of tables that need to be designed and deployed as part of the DW/BI system, including staging tables to support… |