{"ts": 1781926707.9368486, "tasks": [{"name": "chat", "difficulty": "baseline", "active": true, "desc": "Predict the next token of a message from a corpus of simple chat conversations (subtitles, SODA dialogue, short stories). Short dialogues = weak long-range structure, so it mostly tests local language modelling. Vocab ~16k."}, {"name": "wiki", "difficulty": "medium", "active": true, "desc": "Predict the next token in SimpleWiki articles \u2014 REAL long-range structure within an article, so it tests actually using a long context window. Vocab 16384."}, {"name": "web", "difficulty": "medium-hard", "active": false, "desc": "Predict the next token in real web text the system fetched through its sandbox and FILTERED for long-range structure (keeps only text its own filter scores as helpful). Byte-level (vocab 256)."}, {"name": "synth:recall", "difficulty": "D1", "active": true, "desc": "Associative recall \u2014 the system poses this to ITSELF: it is shown (key,value) pairs, then queried with a key and must recall that key's value from earlier in the sequence (a pure memory test). Difficulty D grows the pair count, recall distance and vocab; random baseline ln(V)."}, {"name": "synth:copy", "difficulty": "self-posed", "active": false, "desc": "Copy (self-posed): reproduce an earlier block of tokens \u2014 holding and emitting a span from memory. Difficulty D grows the block length."}], "inventions": {"atoms": [{"name": "ksharp", "kind": "pre", "what": "kk = F.softmax(kk * F.softplus(self.{n}_tau), dim=-1)", "why": "The system invented this one itself: mid-run it diagnosed a specific weakness in its own designs and wrote a new primitive \u2014 NTM softmax key-sharpening / SDM sparse addressing \u2014 that shapes the keys/queries before they reach memory to address it."}, {"name": "read3", "kind": "read", "what": "r1 = torch.einsum('bhij,bhj->bhi', M, qq); r1 = r1 * torch.rsqrt(r1.pow(2).mean(-1, keepdim=True) + 1e-6); r2 = torch.einsum('bhij,bhj->bhi', M, r1); r2 = r2 * torch.rsqrt(r2.pow(2).mean(-1, keepdim=True) + 1e-6); oo = oo + torch.einsum('bh", "why": "The system invented this one itself: mid-run it diagnosed a specific weakness in its own designs and wrote a new primitive \u2014 RMS inter-hop scaling \u2014 that reads from the memory state to address it."}, {"name": "surprise_gated_write", "kind": "write", "what": "er = vv - torch.einsum('bhij,bhj->bhi', M, kk); sg = torch.sigmoid(self.{n}_a * er.pow(2).mean(-1, keepdim=True)); M = M + (sg * er).unsqueeze(-1) * kk.unsqueeze(-2)", "why": "Distilled from a paper the system read when its search stalled \u2014 \"A$^2$RD: Agentic Autoregressive Diffusion for Long Video Consistency\" (arXiv:2605.06924v1). It grows its own primitive vocabulary by reading the literature for mechanisms it lacks, then minting this one (it writes to the memory state) to try in new designs."}, {"name": "interference_cleanup_read", "kind": "read", "what": "r1 = torch.einsum('bhij,bhj->bhi', M, qq); rn = r1 * torch.rsqrt(r1.pow(2).mean(-1, keepdim=True) + 1e-6); r2 = torch.einsum('bhij,bhj->bhi', M, rn); oo = oo + r1 - self.{n}_l * r2", "why": "Distilled from a paper the system read when its search stalled \u2014 \"Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adv\" (arXiv:2604.12811v1). It grows its own primitive vocabulary by reading the literature for mechanisms it lacks, then minting this one (it reads from the memory state) to try in new designs."}, {"name": "sparse_key_selection", "kind": "pre", "what": "thr = kk.abs().topk(max(kk.shape[-1] // 4, 1), -1).values[..., -1:]; kk = kk * (kk.abs() >= thr).to(kk.dtype)", "why": "Distilled from a paper the system read when its search stalled \u2014 \"Mixture of Chapters: Scaling Learnt Memory in Transformers\" (arXiv:2603.21096v1). It grows its own primitive vocabulary by reading the literature for mechanisms it lacks, then minting this one (it shapes the keys/queries before they reach memory) to try in new designs."}, {"name": "usage_saturation_norm", "kind": "write", "what": "us = torch.einsum('bhij,bhj->bhi', M, kk).pow(2).mean(-1, keepdim=True); M = M * torch.rsqrt(1.0 + us).unsqueeze(-1)", "why": "Distilled from a paper the system read when its search stalled \u2014 \"Noisy Channel-Output Feedback Capacity of the Linear Deterministic Interference\" (arXiv:1502.04649v6). It grows its own primitive vocabulary by reading the literature for mechanisms it lacks, then minting this one (it writes to the memory state) to try in new designs."}, {"name": "channel_retention", "kind": "write", "what": "M = torch.sigmoid(self.{n}_p) * M", "why": "Distilled from a paper the system read when its search stalled \u2014 \"Unforgettable Generalization in Language Models\" (arXiv:2409.02228v1). It grows its own primitive vocabulary by reading the literature for mechanisms it lacks, then minting this one (it writes to the memory state) to try in new designs."}, {"name": "novelty_gated_write", "kind": "write", "what": "fam = torch.einsum('bhij,bhj->bhi', M, kk).pow(2).mean(-1, keepdim=True); M = M + (vv / (1.0 + fam)).unsqueeze(-1) * kk.unsqueeze(-2)", "why": "Distilled from a paper the system read when its search stalled \u2014 \"Fast Vocabulary Transfer for Language Model Compression\" (arXiv:2402.09977v1). It grows its own primitive vocabulary by reading the literature for mechanisms it lacks, then minting this one (it writes to the memory state) to try in new designs."}, {"name": "double_delta", "kind": "write", "what": "p1 = torch.einsum('bhij,bhj->bhi', M, kk); M = M + 0.5 * (vv - p1).unsqueeze(-1) * kk.unsqueeze(-2); p2 = torch.einsum('bhij,bhj->bhi', M, kk); M = M + 0.5 * (vv - p2).unsqueeze(-1) * kk.unsqueeze(-2)", "why": "A hand-seeded starting primitive that writes to the memory state, adapted from DeltaProduct / iterative delta-rule. Part of the initial alphabet the search composes on top of and mutates."}, {"name": "softnorm_read", "kind": "read", "what": "rd = torch.einsum('bhij,bhj->bhi', M, qq); oo = oo + rd * torch.rsqrt(rd.pow(2).mean(-1, keepdim=True) + 1e-6)", "why": "A hand-seeded starting primitive that reads from the memory state, adapted from modern Hopfield (normalised sharp read). Part of the initial alphabet the search composes on top of and mutates."}, {"name": "gate_read", "kind": "read", "what": "rd = torch.einsum('bhij,bhj->bhi', M, qq); oo = oo + rd * torch.sigmoid(self.{n}_g(qq))", "why": "A hand-seeded starting primitive that reads from the memory state, adapted from gated attention / output gating. Part of the initial alphabet the search composes on top of and mutates."}, {"name": "ntm_erase", "kind": "write", "what": "ek = torch.einsum('bhij,bhj->bhi', M, kk); M = M - ek.unsqueeze(-1) * kk.unsqueeze(-2); M = M + vv.unsqueeze(-1) * kk.unsqueeze(-2)", "why": "A hand-seeded starting primitive that writes to the memory state, adapted from Neural Turing Machine (erase-then-add). Part of the initial alphabet the search composes on top of and mutates."}, {"name": "temp_read", "kind": "read", "what": "oo = oo + self.{n}_t * torch.einsum('bhij,bhj->bhi', M, qq)", "why": "A hand-seeded starting primitive that reads from the memory state, adapted from temperature-scaled attention. Part of the initial alphabet the search composes on top of and mutates."}, {"name": "householder", "kind": "write", "what": "hk = torch.einsum('bhij,bhj->bhi', M, kk); M = M - 2.0 * hk.unsqueeze(-1) * kk.unsqueeze(-2); M = M + vv.unsqueeze(-1) * kk.unsqueeze(-2)", "why": "A hand-seeded starting primitive that writes to the memory state, adapted from RWKV-7 / householder generalized delta. Part of the initial alphabet the search composes on top of and mutates."}, {"name": "syn31_w252", "kind": "write", "what": "M = M + (((((kk) * (qq))) * (((kk) - (qq))))).unsqueeze(-1) * (kk).unsqueeze(-2)", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it writes to the memory state; val 3.976)."}, {"name": "syn15_w394", "kind": "write", "what": "M = M + (vv).unsqueeze(-1) * (((((kk) + (vv))) * (self.{n}_l1(qq)))).unsqueeze(-2)", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it writes to the memory state; val 3.663)."}, {"name": "syn64_w753", "kind": "write", "what": "M = torch.sigmoid(self.{n}_r) * M; M = M + (((((kk) * (vv))) * ((qq) * torch.rsqrt((qq).pow(2).mean(-1, keepdim=True) + 1e-6)))).unsqueeze(-1) * (vv).unsqueeze(-2)", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it writes to the memory state; val 3.1)."}, {"name": "syn110_r036", "kind": "read", "what": "oo = oo + (((torch.einsum('bhij,bhj->bhi', M, self.{n}_s1 * (vv))) - (kk)))", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it reads from the memory state; val 3.074)."}, {"name": "syn166_r237", "kind": "read", "what": "oo = oo + (torch.einsum('bhij,bhj->bhi', M, torch.tanh(torch.sigmoid(qq))))", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it reads from the memory state; val 3.016)."}, {"name": "syn145_r349", "kind": "read", "what": "oo = oo + (torch.einsum('bhij,bhj->bhi', M, torch.sigmoid(((kk) * (qq)))))", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it reads from the memory state; val 2.857)."}, {"name": "syn215_w327", "kind": "write", "what": "M = M + (((qq) - (torch.sigmoid(vv)))).unsqueeze(-1) * (((vv) * torch.rsqrt((vv).pow(2).mean(-1, keepdim=True) + 1e-6)) * torch.rsqrt(((vv) * torch.rsqrt((vv).pow(2).mean(-1, keepdim=True) + 1e-6)).pow(2).mean(-1, keepdim=True) + 1e-6)).uns", "why": "The search WROTE this operation itself \u2014 every round it mutates its own primitive grammar to mint candidate memory mechanisms, and it kept this one because designs using it scored well (it writes to the memory state; val 0.615)."}], "tasks": [{"name": "synth:recall:1", "when": "current", "what": "self-constructed recall task at difficulty 1 (window 256)", "why": "the system diagnosed that its designs were ignoring long-range context, and posed a memory task they cannot solve WITHOUT using the window"}], "corpuses": [{"name": "web", "when": "built (frozen)", "what": "9 windows of real web text kept for long_range_memory", "why": "fetched real long-range text via the sandbox and kept ONLY windows its long-range-structure filter scored above 0.1882 (median 0.1882) \u2014 the local chat corpus lacks long-range structure"}, {"name": "synth (recall / copy)", "when": "generated per eval", "what": "procedurally generated memory tasks \u2014 a fresh random instance every eval", "why": "a task whose ONLY way to score is to use memory, so a memory architecture's value becomes measurable (unlike chat/wiki, where local prediction already scores well)"}]}, "plan": {"roadmap": [{"name": "Stage 0 \u2014 Substrate builder", "status": "largely built and running unattended. Multi-task worst-case fitness, phase-3 scale-continuity, self-referential gate, and the compounding substrate are live. Current work is maintenance and unblocking (plateau-breaking, robustness, displays) \u2014 necessary, but i", "here": true}, {"name": "Stage 1 \u2014 A core capable enough to BE the operator", "status": "not reached. The language core is weak and plateaued. The whole wiki-plateau fight (TDL #4) is downstream of this stage \u2014 it's an attempt to get capability climbing again.", "here": false}, {"name": "Stage 2 \u2014 The agent loop (the largest unbuilt piece)", "status": "blank page. No agent-loop scaffold exists. This is the biggest distance to the north star. Note: the loop can be stood up with a capable-enough core (Stage 1) even before the core is excellent \u2014 an early, supervised, low-stakes loop (propose \u2192 verify \u2192 human-g", "here": false}, {"name": "Stage 3 \u2014 Hands-off + the flywheel", "status": "not reached; depends on Stage 2. Independence rails (durable launch, owned compute) are partially scaffolded already because they double as Stage-0 infrastructure.", "here": false}], "position": ["Deep in Stage 0, Stage 1 capability-blocked by the plateau, and Stage 2 SCAFFOLDED (not yet load-bearing).", "What moved (2026-06-18/19): the search\u2192core loop is now CLOSED end-to-end \u2014 the long-missing Ouroboros link. The scale-champion is reconstructed into a persistent core (seed/core_builder.py), trained on code, scored, sur", "\u2605 KEY FINDING (2026-06-19, ops_log #46\u201348; Gabriel's \"why optimize capability if handoff is the goal?\"): next-byte CAPABILITY training ACTIVELY DEGRADES handoff. Measured on held-out discrimination: untrained core 0.50 (", "\u2605 FOLLOW-UP (2026-06-19, ops_log #49/#54): interleaved contrastive was ADOPTED (_CORE_CONTRASTIVE=True) and got the champion core to operator 0.4321 \u2014 competitive with the static pack (best static rag2 0.4151) but NOT st", "\u2605 CONFIRMED (2026-06-19, ops_log #55): Gabriel's BIGGER contrastive train (2000nb+600c) was a clean NEGATIVE \u2014 more next-byte recovered code (2.75\u21922.56) but COST handoff (discrim 0.44\u21920.40), and on the harder v4 verified", "\u2605\u2605 OVERTURNED (2026-06-19, ops_log #59): \"the lever is CAPACITY\" was WRONG \u2014 it is SIGNAL. A 2\u00d72 matrix (normal/rich pairs \u00d7 scale_d 1/2) in a dedicated paused GPU window showed: RICHER contrastive training pairs (varied", "The nearest strategically-meaningful milestones, in rough order: 1. Break the capability plateau so cores climb again (Stage 0\u21921 gate). EVOLVED: wiki was a dead binding wall (~0.42) \u2192 demoted from the worst-case min (--d", "Net: the SCAFFOLD for Stages 1\u21922 is now built and wired (loop closed, bench refined, shared-seat v0 live); the project advances to the seat when (1) the plateau breaks so cores actually climb, and (2) the search optimize"], "open": [{"pri": "P0", "title": "AWAITING GABRIEL'S CALL (staged + verified, default-OFF", "status": "flip to deploy)."}, {"pri": "P1", "title": "FIX THE CAPABILITY\u2192HANDOFF GAP", "status": "sequenced AFTER the bench redesign."}, {"pri": "P1", "title": "REDIRECTED NEXT LEVERS from the reason-v2 result -- now BENCH-side, higher-value", "status": ""}, {"pri": "P1", "title": "REFINE operator_bench + COVER THE HANDOFF GAPS", "status": ""}, {"pri": "P1", "title": "CLOSE THE SEARCH\u2192CORE LOOP", "status": "champion becomes the operator core (Gabriel, 2026-06-18)."}, {"pri": "P3", "title": "CUDA vectorized gather kernel index out of bounds asserts", "status": "PERVASIVE but BENIGN; inspection EXHAUSTED, needs a runtime repro (2026-06-19)."}, {"pri": "P1", "title": "THE PIVOT", "status": "SHARED-SEAT OPERATOR LOOP, START NOW (Gabriel, 2026-06-18)."}, {"pri": "P1", "title": "Add a CODE-modeling task to the search suite", "status": "DESIGNED + REVIEWED (workflow wwwbbka06, 8 agents)."}, {"pri": "P2", "title": "Stand up a MINIMAL supervised agent loop", "status": ""}, {"pri": "P1", "title": "PREVENT the stale-queue brain-hang recurrence", "status": ""}, {"pri": "P2", "title": "Deno relay is DOWN", "status": "realtime phone path degraded (2026-06-19, Claude)."}, {"pri": "P2", "title": "Inventions \"why\" copy", "status": ""}, {"pri": "P2", "title": "Watch the synth ladder under --suite", "status": ""}, {"pri": "P3", "title": "Stage B \u2014 learn-to-select on scale-robustness", "status": "learn-to-select on scale-robustness"}, {"pri": "P3", "title": "Worker-requeue-on-preempt", "status": ""}], "done": 11}, "search": {"bar": 0.4518333333333333, "sigma": 0.0013474255287605262, "phase": "research - pushing past inv_61", "plateau": null, "champion": 0.6294, "ratchet_gate": 0.4491, "d": 384, "batch": 64, "steps": 2400, "best_val": 0.6294, "best_nrm": 0.1776, "best_skill": 0.666, "worst_case_loss": 0.334, "capability": 0.766, "level": {"kind": "recall", "difficulty": 1, "window": 256}, "recent": [{"name": "inv_624", "ops": "wdelta>syn623_r069", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.562, "wiki": 0.38, "code": 0.533, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": true, "lme": 0.1649, "val_std": 0.04034850342230703, "pos_loss": [4.1467, 4.2608, 4.1534, 4.3055, 4.2594, 4.0812, 4.4738, 4.2634], "cost": 4, "st_per_s": 3.18, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781924255.396765}, {"name": "inv_616", "ops": "sparse_key_selection>surprise_gated_write>read2>treadr", "val": 0.34, "ppl": 1.4, "topo": "loop", "skill": 0.66, "cap": 0.76, "per_task_skill": {"chat": 0.66, "synth:recall:1": 0.772, "wiki": 0.449, "code": 0.731, "code_discrim": 0.0}, "min_skill": 0.66, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.018, "val_std": 0.045058927784972676, "pos_loss": [3.2845, 3.4654, 3.3635, 3.244, 3.207, 3.0547, 3.4787, 3.1972], "cost": 10, "st_per_s": 21.08, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.34, "kind": null, "ts": 1781923794.8383348}, {"name": "inv_613", "ops": "tq>tq>surprise_gated_write>wgdelta>interference_cleanup_read>softnorm_read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.648, "wiki": 0.429, "code": 0.733, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0407, "val_std": 0.04897395154253908, "pos_loss": [3.3727, 3.5086, 3.4128, 3.4637, 3.3498, 3.2012, 3.6119, 3.3507], "cost": 14, "st_per_s": 1.54, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781923474.3423245}, {"name": "inv_615", "ops": "wdelta>read>read>read", "val": 0.364, "ppl": 1.44, "topo": "stack", "skill": 0.636, "cap": 0.736, "per_task_skill": {"synth:recall:1": 0.754, "chat": 0.636, "wiki": 0.425, "code": 0.686, "code_discrim": 0.0}, "min_skill": 0.636, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.4147, "val_std": 0.048209540571404745, "pos_loss": [3.5114, 3.5398, 3.4751, 3.5473, 3.4458, 3.3343, 3.8068, 3.5287], "cost": 8, "st_per_s": 24.76, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.364, "kind": null, "ts": 1781922062.320012}, {"name": "inv_611", "ops": "channel_retention>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "wiki": 0.39, "code": 0.534, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.168, "val_std": 0.04062741012799118, "pos_loss": [4.1217, 4.2357, 4.1623, 4.281, 4.2374, 4.0502, 4.4596, 4.2337], "cost": 5, "st_per_s": 3.08, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781921932.1192524}, {"name": "inv_609", "ops": "ksharp>knorm>wadd>wadd>read", "val": 0.362, "ppl": 1.44, "topo": "stack", "skill": 0.638, "cap": 0.738, "per_task_skill": {"synth:recall:1": 0.737, "chat": 0.638, "wiki": 0.429, "code": 0.68, "code_discrim": 0.0}, "min_skill": 0.638, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.4545, "val_std": 0.0468666564329255, "pos_loss": [3.5163, 3.5726, 3.412, 3.5607, 3.4247, 3.3605, 3.7777, 3.4293], "cost": 7, "st_per_s": 29.64, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.362, "kind": null, "ts": 1781921120.8142922}, {"name": "inv_610", "ops": "sparse_key_selection>surprise_gated_write>read2>read2", "val": 0.334, "ppl": 1.4, "topo": "cont", "skill": 0.666, "cap": 0.766, "per_task_skill": {"chat": 0.666, "synth:recall:1": 0.769, "wiki": 0.445, "code": 0.755, "code_discrim": 0.0}, "min_skill": 0.666, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0001, "val_std": 0.048230200327381345, "pos_loss": [3.2293, 3.3334, 3.2542, 3.2626, 3.1702, 3.0465, 3.4217, 3.1802], "cost": 9, "st_per_s": 9.47, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.334, "kind": null, "ts": 1781921000.6122067}, {"name": "inv_651", "ops": "syn650_w905>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"synth:recall:1": 0.547, "code": 0.575, "code_discrim": 0.0}, "min_skill": null, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": true, "lme": -0.1723, "val_std": 0.007934822724889299, "pos_loss": [2.4965, 2.1224, 2.2173, 2.1946, 2.096, 2.1826, 2.2145, 2.0599], "cost": 3, "st_per_s": 21.65, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781910259.6685376}, {"name": "inv_637", "ops": "wdelta>read>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"synth:recall:1": 0.743}, "min_skill": null, "worst_task": "synth:recall:1", "ext": "none", "stack": true, "synth": false, "lme": -0.3936, "val_std": 0.011149971673156133, "pos_loss": [1.9487, 1.1361, 1.1405, 1.189, 1.1285, 1.1314, 1.1735, 1.1242], "cost": 7, "st_per_s": 10.67, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781909648.7422173}, {"name": "inv_631", "ops": "surprise_gated_write>read2>treadr>gate_read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.651}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.0248, "val_std": 0.04913922959035191, "pos_loss": [3.3989, 3.4317, 3.4234, 3.4557, 3.3269, 3.1885, 3.5969, 3.184], "cost": 13, "st_per_s": 0.75, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781907817.6936677}, {"name": "inv_622", "ops": "sparse_key_selection>qnorm>erase>read>gatev", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.598, "code": 0.582, "wiki": 0.403, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.1579, "val_std": 0.04590597778001343, "pos_loss": [3.8275, 3.9042, 3.807, 3.9394, 3.8369, 3.7395, 4.1939, 3.8536], "cost": 9, "st_per_s": 3.24, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781904699.7798665}, {"name": "inv_621", "ops": "wdelta>read2", "val": 0.351, "ppl": 1.42, "topo": "cont", "skill": 0.649, "cap": 0.749, "per_task_skill": {"chat": 0.649, "synth:recall:1": 0.769, "code": 0.75, "wiki": 0.43, "code_discrim": 0.0}, "min_skill": 0.649, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0342, "val_std": 0.048447127765135684, "pos_loss": [3.3771, 3.523, 3.3961, 3.3823, 3.2266, 3.2093, 3.6317, 3.3992], "cost": 5, "st_per_s": 13.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.351, "kind": null, "ts": 1781902966.5346937}, {"name": "inv_609", "ops": "usage_saturation_norm>read", "val": 0.564, "ppl": 1.76, "topo": "loop", "skill": 0.43599999999999994, "cap": 0.536, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.436, "code": 0.534, "wiki": 0.388, "code_discrim": 0.0}, "min_skill": 0.43599999999999994, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": false, "lme": -0.0061, "val_std": 0.00762567378755595, "pos_loss": [2.8222, 2.6845, 2.6992, 2.8249, 2.6838, 2.6968, 2.8211, 2.6734], "cost": 4, "st_per_s": 2.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.564, "kind": null, "ts": 1781898688.2580526}, {"name": "inv_606", "ops": "surprise_gated_write>sparse_key_selection>read2>surprise_gated_write>read2>read2", "val": 0.351, "ppl": 1.42, "topo": "loop", "skill": 0.649, "cap": 0.749, "per_task_skill": {"chat": 0.649, "synth:recall:1": 0.772, "code": 0.728, "wiki": 0.424, "code_discrim": 0.0}, "min_skill": 0.649, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0303, "val_std": 0.04809591191353342, "pos_loss": [3.4093, 3.5174, 3.469, 3.4101, 3.3268, 3.1518, 3.5374, 3.3527], "cost": 14, "st_per_s": 2.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.351, "kind": null, "ts": 1781896996.1443973}, {"name": "inv_621", "ops": "usage_saturation_norm>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "code": 0.533, "wiki": 0.392, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1809, "val_std": 0.040586090616037976, "pos_loss": [4.125, 4.2206, 4.1461, 4.2657, 4.2305, 4.0417, 4.48, 4.2274], "cost": 4, "st_per_s": 5.07, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781891916.4468968}, {"name": "inv_617", "ops": "gatev>knorm>wadd>read2", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.634, "code": 0.684, "wiki": 0.413, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": true, "synth": false, "lme": 0.0752, "val_std": 0.048230200327381345, "pos_loss": [3.5994, 3.5497, 3.4803, 3.5942, 3.4047, 3.3852, 3.7996, 3.4999], "cost": 9, "st_per_s": 3.09, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781891495.7402189}, {"name": "inv_616", "ops": "wdelta>tq>read", "val": 0.429, "ppl": 1.54, "topo": "stack", "skill": 0.571, "cap": 0.671, "per_task_skill": {"chat": 0.628, "synth:recall:1": 0.571, "code": 0.665, "wiki": 0.423, "code_discrim": 0.0}, "min_skill": 0.571, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": false, "lme": -0.1684, "val_std": 0.0066157872589336746, "pos_loss": [2.4404, 1.9733, 2.0474, 2.1109, 1.9711, 2.0472, 2.1076, 1.9693], "cost": 6, "st_per_s": 9.47, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.429, "kind": null, "ts": 1781890845.1061318}, {"name": "inv_615", "ops": "syn614_w418>read", "val": 0.477, "ppl": 1.61, "topo": "stack", "skill": 0.523, "cap": 0.623, "per_task_skill": {"chat": 0.582, "synth:recall:1": 0.523, "code": 0.572, "wiki": 0.401, "code_discrim": 0.0}, "min_skill": 0.523, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": true, "lme": -0.1839, "val_std": 0.04598075194604682, "pos_loss": [2.6641, 2.2394, 2.3009, 2.2967, 2.2439, 2.2091, 2.3022, 2.2335], "cost": 4, "st_per_s": 26.32, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.477, "kind": null, "ts": 1781888620.754562}, {"name": "inv_604", "ops": "double_delta>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.588, "code": 0.609, "wiki": 0.399, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1384, "val_std": 0.0429309729193825, "pos_loss": [3.8876, 4.0875, 3.885, 4.0262, 3.9747, 3.8198, 4.2537, 3.9982], "cost": 5, "st_per_s": 2.78, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781888610.7348266}, {"name": "inv_602", "ops": "surprise_gated_write>treadr>knorm", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.64, "code": 0.728, "wiki": 0.433, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0941, "val_std": 0.0480029430116387, "pos_loss": [3.3905, 3.5956, 3.5007, 3.5226, 3.4309, 3.2424, 3.7298, 3.4446], "cost": 7, "st_per_s": 1.89, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781888290.1295116}, {"name": "inv_607", "ops": "surprise_gated_write>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.64, "code": 0.729, "wiki": 0.422, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.0347, "val_std": 0.04709391374866814, "pos_loss": [3.432, 3.5433, 3.5031, 3.6349, 3.4442, 3.2725, 3.6939, 3.3507], "cost": 7, "st_per_s": 3.56, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781887729.4368913}, {"name": "inv_603", "ops": "channel_retention>softnorm_read", "val": 0.564, "ppl": 1.76, "topo": "loop", "skill": 0.43599999999999994, "cap": 0.536, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.436, "code": 0.534, "wiki": 0.389, "code_discrim": 0.0}, "min_skill": 0.43599999999999994, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": false, "lme": -0.0059, "val_std": 0.007151645416978148, "pos_loss": [2.8197, 2.6802, 2.6955, 2.8206, 2.6813, 2.6924, 2.8177, 2.6705], "cost": 3, "st_per_s": 2.3, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.564, "kind": null, "ts": 1781887399.018516}, {"name": "inv_606", "ops": "channel_retention>wadd>wadd>wadd>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.619, "code": 0.644, "wiki": 0.421, "code_discrim": 0.0}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1128, "val_std": 0.04608158570581456, "pos_loss": [3.7342, 3.6854, 3.6382, 3.6867, 3.6217, 3.5133, 4.008, 3.6372], "cost": 6, "st_per_s": 3.06, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781886938.3500223}, {"name": "inv_601", "ops": "surprise_gated_write>treadr>treadr", "val": 0.354, "ppl": 1.42, "topo": "loop", "skill": 0.646, "cap": 0.746, "per_task_skill": {"chat": 0.646, "synth:recall:1": 0.767, "code": 0.735, "wiki": 0.438, "code_discrim": 0.0}, "min_skill": 0.646, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0065, "val_std": 0.04757941801411833, "pos_loss": [3.3852, 3.4749, 3.4581, 3.4802, 3.3689, 3.2042, 3.66, 3.3973], "cost": 10, "st_per_s": 20.87, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.354, "kind": null, "ts": 1781886557.8031857}, {"name": "inv_605", "ops": "sparse_key_selection>surprise_gated_write>read2>read2>read2", "val": 0.34, "ppl": 1.4, "topo": "loop", "skill": 0.66, "cap": 0.76, "per_task_skill": {"chat": 0.66, "synth:recall:1": 0.77, "code": 0.727, "wiki": 0.439, "code_discrim": 0.0}, "min_skill": 0.66, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0149, "val_std": 0.04681500704298399, "pos_loss": [3.2886, 3.4586, 3.3235, 3.2973, 3.2092, 3.0768, 3.4107, 3.2496], "cost": 12, "st_per_s": 17.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.34, "kind": null, "ts": 1781886447.5525863}, {"name": "inv_600", "ops": "sparse_key_selection>surprise_gated_write>read2>read2", "val": 0.335, "ppl": 1.4, "topo": "cont", "skill": 0.665, "cap": 0.765, "per_task_skill": {"chat": 0.665, "synth:recall:1": 0.768, "code": 0.755, "wiki": 0.445, "code_discrim": 0.0}, "min_skill": 0.665, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0146, "val_std": 0.05000693934136926, "pos_loss": [3.2176, 3.3638, 3.2634, 3.2361, 3.2048, 3.0481, 3.4291, 3.2028], "cost": 9, "st_per_s": 11.61, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.335, "kind": null, "ts": 1781886367.4101565}, {"name": "inv_633", "ops": "novelty_gated_write>sparse_key_selection>read2", "val": 0.366, "ppl": 1.44, "topo": "stack", "skill": 0.634, "cap": 0.734, "per_task_skill": {"chat": 0.634, "synth:recall:1": 0.745, "code": 0.684, "wiki": 0.425}, "min_skill": 0.634, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.4073, "val_std": 0.04780667532986097, "pos_loss": [3.5209, 3.5682, 3.4655, 3.5951, 3.4704, 3.3946, 3.8357, 3.5274], "cost": 7, "st_per_s": 5.67, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.366, "kind": null, "ts": 1781884533.945369}, {"name": "inv_634", "ops": "ntm_erase>sparse_key_selection>treadr", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.639, "code": 0.693, "wiki": 0.426}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": 0.0795, "val_std": 0.04841613813117078, "pos_loss": [3.5172, 3.5226, 3.4532, 3.5124, 3.4079, 3.3371, 3.7691, 3.4296], "cost": 8, "st_per_s": 4.73, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781884123.1651492}, {"name": "inv_638", "ops": "novelty_gated_write>qnorm>treadr", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.638, "code": 0.682, "wiki": 0.427}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": 0.0776, "val_std": 0.04804426252359191, "pos_loss": [3.5257, 3.5435, 3.4463, 3.5039, 3.4339, 3.3923, 3.7755, 3.4489], "cost": 8, "st_per_s": 4.47, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781883932.7778971}, {"name": "inv_632", "ops": "novelty_gated_write>sparse_key_selection>treadr", "val": 0.363, "ppl": 1.44, "topo": "stack", "skill": 0.637, "cap": 0.737, "per_task_skill": {"chat": 0.637, "synth:recall:1": 0.741, "code": 0.683, "wiki": 0.427}, "min_skill": 0.637, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.4512, "val_std": 0.048106241791521724, "pos_loss": [3.53, 3.5372, 3.4487, 3.509, 3.4384, 3.3954, 3.7796, 3.4451], "cost": 8, "st_per_s": 6.3, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.363, "kind": null, "ts": 1781883732.374131}, {"name": "inv_637", "ops": "wadd>sparse_key_selection>read3", "val": 0.468, "ppl": 1.6, "topo": "cont", "skill": 0.532, "cap": 0.632, "per_task_skill": {"chat": 0.532, "synth:recall:1": 0.754, "code": 0.648, "wiki": 0.316}, "min_skill": 0.532, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0206, "val_std": 0.04448045461762777, "pos_loss": [4.5653, 4.5705, 4.517, 4.5627, 4.4653, 4.3296, 4.6524, 4.5774], "cost": 6, "st_per_s": 13.88, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.468, "kind": null, "ts": 1781883381.7244916}, {"name": "inv_635", "ops": "sparse_key_selection>surprise_gated_write>read2", "val": 0.335, "ppl": 1.4, "topo": "cont", "skill": 0.665, "cap": 0.765, "per_task_skill": {"chat": 0.665, "synth:recall:1": 0.77, "code": 0.762, "wiki": 0.451}, "min_skill": 0.665, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0014, "val_std": 0.04786865459779078, "pos_loss": [3.2291, 3.3601, 3.2775, 3.258, 3.1249, 3.0537, 3.4238, 3.1945], "cost": 6, "st_per_s": 11.23, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.335, "kind": null, "ts": 1781883261.4596155}, {"name": "inv_631", "ops": "syn630_p965>wdelta>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.565, "code": 0.534, "wiki": 0.393}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": true, "lme": 0.1731, "val_std": 0.039553102817207794, "pos_loss": [4.1101, 4.2365, 4.1473, 4.2626, 4.2339, 4.038, 4.4577, 4.2351], "cost": 6, "st_per_s": 2.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781881594.5240612}, {"name": "inv_621", "ops": "wdelta>read>gate_read>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.637, "code": 0.691, "wiki": 0.42}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": true, "synth": false, "lme": 0.1393, "val_std": 0.047496778990211916, "pos_loss": [3.491, 3.5429, 3.435, 3.5786, 3.413, 3.3386, 3.7867, 3.5259], "cost": 11, "st_per_s": 2.23, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781881283.9353514}, {"name": "inv_620", "ops": "sparse_key_selection>surprise_gated_write>read2>softnorm_read", "val": null, "ppl": null, "topo": "cont", "skill": null, "cap": null, "per_task_skill": {"chat": 0.658, "code": 0.767, "wiki": 0.433}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0043, "val_std": 0.04886032288466775, "pos_loss": [3.3241, 3.4197, 3.3649, 3.2862, 3.2096, 3.1101, 3.497, 3.2554], "cost": 8, "st_per_s": 1.2, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781880803.0100203}, {"name": "inv_624", "ops": "channel_retention>qnorm>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "code": 0.534, "wiki": 0.392}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1825, "val_std": 0.04079268817580401, "pos_loss": [4.1252, 4.2193, 4.1465, 4.2664, 4.2296, 4.0403, 4.4802, 4.2294], "cost": 4, "st_per_s": 4.2, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781880011.4739568}, {"name": "inv_623", "ops": "wdelta>read", "val": 0.564, "ppl": 1.76, "topo": "loop", "skill": 0.43599999999999994, "cap": 0.536, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.436, "code": 0.534, "wiki": 0.389}, "min_skill": 0.43599999999999994, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": false, "lme": -0.0057, "val_std": 0.007708113504178177, "pos_loss": [2.8212, 2.6836, 2.699, 2.8239, 2.6828, 2.6952, 2.8207, 2.6728], "cost": 4, "st_per_s": 19.51, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.564, "kind": null, "ts": 1781879801.124483}, {"name": "inv_616", "ops": "decay>decay>read>temp_read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "code": 0.534, "wiki": 0.389}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1804, "val_std": 0.040214215008459106, "pos_loss": [4.113, 4.2289, 4.1503, 4.2812, 4.2459, 4.0568, 4.4603, 4.2424], "cost": 6, "st_per_s": 4.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781879751.0315807}, {"name": "inv_618", "ops": "sparse_key_selection>qnorm>erase>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.599, "code": 0.58, "wiki": 0.401}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.1406, "val_std": 0.04560641131835268, "pos_loss": [3.829, 3.8962, 3.8348, 3.956, 3.815, 3.7571, 4.1731, 3.8333], "cost": 7, "st_per_s": 3.22, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781879520.557542}, {"name": "inv_626", "ops": "gatev>knorm>wadd>read2", "val": 0.365, "ppl": 1.44, "topo": "stack", "skill": 0.635, "cap": 0.735, "per_task_skill": {"chat": 0.635, "synth:recall:1": 0.734, "code": 0.682, "wiki": 0.427}, "min_skill": 0.635, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.3559, "val_std": 0.04795129362169719, "pos_loss": [3.5345, 3.5601, 3.4812, 3.564, 3.4339, 3.3849, 3.8324, 3.5143], "cost": 8, "st_per_s": 29.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.365, "kind": null, "ts": 1781879179.9437852}, {"name": "inv_627", "ops": "sparse_key_selection>surprise_gated_write>read2>read2", "val": 0.339, "ppl": 1.4, "topo": "loop", "skill": 0.661, "cap": 0.761, "per_task_skill": {"chat": 0.661, "synth:recall:1": 0.772, "code": 0.73, "wiki": 0.445}, "min_skill": 0.661, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0103, "val_std": 0.04777568569589607, "pos_loss": [3.2682, 3.4693, 3.3014, 3.3019, 3.1792, 3.1037, 3.3813, 3.2375], "cost": 9, "st_per_s": 16.92, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.339, "kind": null, "ts": 1781879109.7919822}, {"name": "inv_622", "ops": "sparse_key_selection>surprise_gated_write>read2>treadr", "val": 0.34, "ppl": 1.4, "topo": "loop", "skill": 0.66, "cap": 0.76, "per_task_skill": {"chat": 0.66, "synth:recall:1": 0.771, "code": 0.731, "wiki": 0.449}, "min_skill": 0.66, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0097, "val_std": 0.04786865459779078, "pos_loss": [3.2733, 3.4689, 3.3866, 3.3148, 3.1917, 3.0886, 3.4767, 3.1734], "cost": 10, "st_per_s": 19.03, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.34, "kind": null, "ts": 1781879019.6052725}, {"name": "inv_619", "ops": "wdelta>read>read>read", "val": 0.363, "ppl": 1.44, "topo": "stack", "skill": 0.637, "cap": 0.737, "per_task_skill": {"chat": 0.637, "synth:recall:1": 0.744, "code": 0.693, "wiki": 0.428}, "min_skill": 0.637, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.3861, "val_std": 0.04787898447577908, "pos_loss": [3.5015, 3.5279, 3.4068, 3.5662, 3.431, 3.3434, 3.8148, 3.495], "cost": 9, "st_per_s": 26.96, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.363, "kind": null, "ts": 1781878949.476438}, {"name": "inv_615", "ops": "wdelta>syn614_r003", "val": 0.371, "ppl": 1.45, "topo": "stack", "skill": 0.629, "cap": 0.729, "per_task_skill": {"chat": 0.629, "synth:recall:1": 0.785, "code": 0.672, "wiki": 0.411}, "min_skill": 0.629, "worst_task": "chat", "ext": "none", "stack": false, "synth": true, "lme": -0.454, "val_std": 0.047424469844293805, "pos_loss": [3.619, 3.5722, 3.5464, 3.6184, 3.4717, 3.445, 3.9027, 3.529], "cost": 4, "st_per_s": 4.4, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.371, "kind": null, "ts": 1781875150.756144}, {"name": "inv_604", "ops": "surprise_gated_write>sparse_key_selection>read2>surprise_gated_write>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.638, "code": 0.719, "wiki": 0.409}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.0038, "val_std": 0.048157891181463235, "pos_loss": [3.5122, 3.5624, 3.5827, 3.5898, 3.4393, 3.2475, 3.7272, 3.3397], "cost": 12, "st_per_s": 0.37, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781874770.0573242}, {"name": "inv_602", "ops": "gatev>wgdelta>tq>read2>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.607, "code": 0.618, "wiki": 0.407}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.1614, "val_std": 0.04364373450057532, "pos_loss": [3.7744, 3.7913, 3.6997, 3.8724, 3.7448, 3.6466, 4.1181, 3.7704], "cost": 13, "st_per_s": 3.06, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781874399.3275387}, {"name": "inv_600", "ops": "householder>wadd>read", "val": 0.388, "ppl": 1.47, "topo": "stack", "skill": 0.612, "cap": 0.712, "per_task_skill": {"chat": 0.612, "synth:recall:1": 0.846, "code": 0.646, "wiki": 0.412}, "min_skill": 0.612, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.4916, "val_std": 0.04646379119138173, "pos_loss": [3.6429, 3.7496, 3.6452, 3.7994, 3.699, 3.5748, 4.1038, 3.8341], "cost": 5, "st_per_s": 4.67, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.388, "kind": null, "ts": 1781872746.3872182}, {"name": "inv_601", "ops": "qnorm>surprise_gated_write>read2>read2>read2", "val": 0.35, "ppl": 1.42, "topo": "loop", "skill": 0.65, "cap": 0.75, "per_task_skill": {"chat": 0.65, "synth:recall:1": 0.769, "code": 0.736, "wiki": 0.423}, "min_skill": 0.65, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0192, "val_std": 0.049438796052012665, "pos_loss": [3.3614, 3.4915, 3.4345, 3.3719, 3.3149, 3.1812, 3.6038, 3.3748], "cost": 12, "st_per_s": 17.35, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.35, "kind": null, "ts": 1781872245.5018287}, {"name": "inv_603", "ops": "decay>wadd>ksharp>read>read", "val": 0.374, "ppl": 1.45, "topo": "cont", "skill": 0.626, "cap": 0.726, "per_task_skill": {"chat": 0.626, "synth:recall:1": 0.746, "code": 0.726, "wiki": 0.415}, "min_skill": 0.626, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.036, "val_std": 0.04622620399765079, "pos_loss": [3.594, 3.6636, 3.57, 3.6723, 3.5235, 3.4407, 3.9079, 3.6171], "cost": 7, "st_per_s": 14.74, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.374, "kind": null, "ts": 1781872175.3974488}, {"name": "inv_599", "ops": "wdelta>syn598_r325", "val": 0.563, "ppl": 1.76, "topo": "stack", "skill": 0.43700000000000006, "cap": 0.537, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.437, "code": 0.533, "wiki": 0.391}, "min_skill": 0.43700000000000006, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": true, "lme": -0.0054, "val_std": 0.007357744708533715, "pos_loss": [2.8194, 2.6822, 2.6964, 2.822, 2.6826, 2.6915, 2.819, 2.6718], "cost": 4, "st_per_s": 1.6, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.563, "kind": null, "ts": 1781866974.3421538}, {"name": "inv_585", "ops": "wgdelta>wgdelta>decay>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.597, "code": 0.629, "wiki": 0.409}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1451, "val_std": 0.043530105842704, "pos_loss": [3.8009, 3.9629, 3.7761, 3.954, 3.874, 3.7373, 4.1507, 3.9033], "cost": 9, "st_per_s": 1.77, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781866473.3892612}, {"name": "inv_586", "ops": "sparse_key_selection>qnorm>erase>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.598, "code": 0.58, "wiki": 0.401}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.142, "val_std": 0.04557542168438777, "pos_loss": [3.8363, 3.9009, 3.837, 3.9571, 3.8164, 3.7596, 4.1793, 3.8419], "cost": 7, "st_per_s": 3.58, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781865872.2121894}, {"name": "inv_587", "ops": "surprise_gated_write>sparse_key_selection>read2>surprise_gated_write>read2", "val": 0.354, "ppl": 1.42, "topo": "loop", "skill": 0.646, "cap": 0.746, "per_task_skill": {"chat": 0.646, "synth:recall:1": 0.768, "code": 0.723, "wiki": 0.437}, "min_skill": 0.646, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0202, "val_std": 0.04763106740405984, "pos_loss": [3.3488, 3.5039, 3.458, 3.4634, 3.3791, 3.2096, 3.6975, 3.3953], "cost": 11, "st_per_s": 2.68, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.354, "kind": null, "ts": 1781865511.5360618}, {"name": "inv_584", "ops": "wgdelta>read", "val": 0.564, "ppl": 1.76, "topo": "loop", "skill": 0.43599999999999994, "cap": 0.536, "per_task_skill": {"chat": 0.563, "synth:recall:1": 0.436, "code": 0.556, "wiki": 0.389}, "min_skill": 0.43599999999999994, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": false, "lme": -0.0055, "val_std": 0.007666893645867062, "pos_loss": [2.8193, 2.6799, 2.6952, 2.8203, 2.68, 2.6912, 2.8182, 2.67], "cost": 5, "st_per_s": 13.62, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.564, "kind": null, "ts": 1781865411.3735762}, {"name": "inv_623", "ops": "ksharp>ntm_erase>read3", "val": null, "ppl": null, "topo": "cont", "skill": null, "cap": null, "per_task_skill": {"chat": 0.624, "code": 0.698}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1486, "val_std": 0.04555476192841117, "pos_loss": [3.5656, 3.6348, 3.6183, 3.6752, 3.5981, 3.4891, 3.8884, 3.6091], "cost": 7, "st_per_s": 1.09, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781848479.7864072}, {"name": "inv_632", "ops": "syn631_w868>read", "val": 0.418, "ppl": 1.52, "topo": "stack", "skill": 0.582, "cap": 0.682, "per_task_skill": {"chat": 0.582, "synth:recall:1": 0.689, "wiki": 0.401, "code": 0.578}, "min_skill": 0.582, "worst_task": "chat", "ext": "none", "stack": false, "synth": true, "lme": -0.619, "val_std": 0.04342680706282098, "pos_loss": [4.0811, 4.0755, 3.967, 4.0909, 4.0341, 3.834, 4.2789, 3.985], "cost": 3, "st_per_s": 29.37, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.418, "kind": null, "ts": 1781848269.3932192}, {"name": "inv_619", "ops": "sparse_key_selection>surprise_gated_write>softnorm_read>read2>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.646, "code": 0.714}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.1265, "val_std": 0.04825086008335795, "pos_loss": [3.4731, 3.5249, 3.5119, 3.5985, 3.3471, 3.2214, 3.5937, 3.1513], "cost": 12, "st_per_s": 1.13, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781847778.272624}, {"name": "inv_618", "ops": "knorm>surprise_gated_write>surprise_gated_write>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.653, "wiki": 0.436, "code": 0.719}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0486, "val_std": 0.048137231425486635, "pos_loss": [3.34, 3.4468, 3.3685, 3.4113, 3.2687, 3.1782, 3.5468, 3.3372], "cost": 8, "st_per_s": 2.4, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781846766.1775682}, {"name": "inv_617", "ops": "sparse_key_selection>surprise_gated_write>usage_saturation_norm>surprise_gated_write>read2", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.643, "wiki": 0.431, "code": 0.696}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1056, "val_std": 0.049335497272129644, "pos_loss": [3.4751, 3.4642, 3.3727, 3.5061, 3.3914, 3.3057, 3.7231, 3.4273], "cost": 10, "st_per_s": 1.17, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781845945.1372292}, {"name": "inv_621", "ops": "wdelta>read>read2>read2>read2", "val": 0.362, "ppl": 1.44, "topo": "loop", "skill": 0.638, "cap": 0.738, "per_task_skill": {"chat": 0.638, "synth:recall:1": 0.77, "wiki": 0.405, "code": 0.722}, "min_skill": 0.638, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0392, "val_std": 0.04703193448073833, "pos_loss": [3.4625, 3.5616, 3.5431, 3.5359, 3.4275, 3.2649, 3.6818, 3.5366], "cost": 13, "st_per_s": 19.01, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.362, "kind": null, "ts": 1781845294.2104466}, {"name": "inv_622", "ops": "surprise_gated_write>interference_cleanup_read", "val": 0.393, "ppl": 1.48, "topo": "cont", "skill": 0.607, "cap": 0.707, "per_task_skill": {"chat": 0.607, "synth:recall:1": 0.742, "wiki": 0.403, "code": 0.695}, "min_skill": 0.607, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.016, "val_std": 0.044542433885557585, "pos_loss": [3.7475, 3.8461, 3.7224, 3.8877, 3.8129, 3.6333, 4.0576, 3.7243], "cost": 5, "st_per_s": 11.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.393, "kind": null, "ts": 1781845204.071304}, {"name": "inv_620", "ops": "wdelta>read>read>read", "val": 0.363, "ppl": 1.44, "topo": "stack", "skill": 0.637, "cap": 0.737, "per_task_skill": {"chat": 0.637, "synth:recall:1": 0.744, "wiki": 0.428, "code": 0.693}, "min_skill": 0.637, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.3854, "val_std": 0.04787898447577908, "pos_loss": [3.4982, 3.5262, 3.4058, 3.5635, 3.4321, 3.3414, 3.8164, 3.4978], "cost": 9, "st_per_s": 24.7, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.363, "kind": null, "ts": 1781845023.806112}, {"name": "inv_616", "ops": "syn615_p796>wdelta>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.629, "wiki": 0.411, "code": 0.677}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": true, "lme": 0.1248, "val_std": 0.047496778990211916, "pos_loss": [3.5842, 3.602, 3.5228, 3.65, 3.5298, 3.4161, 3.8615, 3.5742], "cost": 5, "st_per_s": 3.22, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781842849.4107602}, {"name": "inv_603", "ops": "surprise_gated_write>read2>treadr>gatev", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.658, "wiki": 0.442, "code": 0.734}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0776, "val_std": 0.04735216069837569, "pos_loss": [3.291, 3.3528, 3.3463, 3.358, 3.2313, 3.1021, 3.5245, 3.2745], "cost": 11, "st_per_s": 2.05, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781842248.709253}, {"name": "inv_604", "ops": "decay>wadd>ksharp>read>read", "val": 0.374, "ppl": 1.45, "topo": "cont", "skill": 0.626, "cap": 0.726, "per_task_skill": {"chat": 0.626, "synth:recall:1": 0.748, "wiki": 0.415, "code": 0.727}, "min_skill": 0.626, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0436, "val_std": 0.04622620399765079, "pos_loss": [3.594, 3.6636, 3.57, 3.6723, 3.5235, 3.4407, 3.9079, 3.6171], "cost": 7, "st_per_s": 14.98, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.374, "kind": null, "ts": 1781841637.8401616}, {"name": "inv_602", "ops": "surprise_gated_write>read2>treadr", "val": 0.344, "ppl": 1.41, "topo": "loop", "skill": 0.656, "cap": 0.756, "per_task_skill": {"chat": 0.656, "synth:recall:1": 0.771, "wiki": 0.442, "code": 0.735}, "min_skill": 0.656, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0055, "val_std": 0.048695044836854925, "pos_loss": [3.2459, 3.4159, 3.3801, 3.4292, 3.2381, 3.1483, 3.5087, 3.3159], "cost": 9, "st_per_s": 20.28, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.344, "kind": null, "ts": 1781841497.610822}, {"name": "inv_601", "ops": "sparse_key_selection>surprise_gated_write>read2>treadr", "val": 0.34, "ppl": 1.4, "topo": "loop", "skill": 0.66, "cap": 0.76, "per_task_skill": {"chat": 0.66, "synth:recall:1": 0.771, "wiki": 0.449, "code": 0.731}, "min_skill": 0.66, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.0086, "val_std": 0.04786865459779078, "pos_loss": [3.2733, 3.4689, 3.3866, 3.3148, 3.1917, 3.0886, 3.4767, 3.1734], "cost": 10, "st_per_s": 17.34, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.34, "kind": null, "ts": 1781841407.42635}, {"name": "inv_588", "ops": "ntm_erase>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.633, "wiki": 0.416, "code": 0.718}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.0017, "val_std": 0.046215874119662485, "pos_loss": [3.5507, 3.6159, 3.5766, 3.6543, 3.539, 3.3172, 3.7421, 3.4279], "cost": 7, "st_per_s": 1.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781840324.6190774}, {"name": "inv_591", "ops": "wgdelta>sparse_key_selection>read2>surprise_gated_write>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.656, "wiki": 0.432, "code": 0.737}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.0709, "val_std": 0.04781700520784927, "pos_loss": [3.3639, 3.4753, 3.3823, 3.319, 3.2004, 3.177, 3.4791, 3.2182], "cost": 12, "st_per_s": 2.61, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781839513.5681474}, {"name": "inv_593", "ops": "surprise_gated_write>read2>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.651, "wiki": 0.422, "code": 0.726}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.1171, "val_std": 0.04922186861425832, "pos_loss": [3.4009, 3.5332, 3.4641, 3.4426, 3.3142, 3.1518, 3.5251, 3.1748], "cost": 10, "st_per_s": 3.1, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781838732.4502015}, {"name": "inv_592", "ops": "surprise_gated_write>temp_read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.654, "wiki": 0.441, "code": 0.734}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.08, "val_std": 0.04858141617898361, "pos_loss": [3.2941, 3.4598, 3.3567, 3.3763, 3.2863, 3.1578, 3.591, 3.3228], "cost": 4, "st_per_s": 4.55, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781838081.524449}, {"name": "inv_590", "ops": "wadd>read", "val": 0.404, "ppl": 1.5, "topo": "stack", "skill": 0.596, "cap": 0.696, "per_task_skill": {"chat": 0.596, "synth:recall:1": 0.766, "wiki": 0.408, "code": 0.617}, "min_skill": 0.596, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.35, "val_std": 0.045182886320832304, "pos_loss": [3.9075, 3.8987, 3.8415, 3.9665, 3.881, 3.7447, 4.1874, 3.8687], "cost": 3, "st_per_s": 27.49, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.404, "kind": null, "ts": 1781837610.8648148}, {"name": "inv_587", "ops": "knorm>knorm>wadd>wadd>read", "val": 0.409, "ppl": 1.51, "topo": "stack", "skill": 0.591, "cap": 0.691, "per_task_skill": {"chat": 0.591, "synth:recall:1": 0.748, "wiki": 0.406, "code": 0.605}, "min_skill": 0.591, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.4626, "val_std": 0.04530684485669192, "pos_loss": [4.0077, 3.9534, 3.8772, 3.9942, 3.9288, 3.7668, 4.2454, 3.9129], "cost": 6, "st_per_s": 21.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.409, "kind": null, "ts": 1781837500.7162187}, {"name": "inv_586", "ops": "wdelta>treadr", "val": 0.366, "ppl": 1.44, "topo": "stack", "skill": 0.634, "cap": 0.734, "per_task_skill": {"chat": 0.634, "synth:recall:1": 0.746, "wiki": 0.425, "code": 0.68}, "min_skill": 0.634, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": -0.3998, "val_std": 0.04752776862417682, "pos_loss": [3.5146, 3.5608, 3.4836, 3.557, 3.5056, 3.3839, 3.8131, 3.5037], "cost": 6, "st_per_s": 22.06, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.366, "kind": null, "ts": 1781837360.4822621}, {"name": "inv_585", "ops": "syn584_w228>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {}, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": null, "val_std": null, "pos_loss": null, "cost": 4, "st_per_s": null, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781834896.097528}, {"name": "inv_575", "ops": "channel_retention>treadr", "val": 0.564, "ppl": 1.76, "topo": "loop", "skill": 0.43599999999999994, "cap": 0.536, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.436, "wiki": 0.39, "code": 0.534}, "min_skill": 0.43599999999999994, "worst_task": "synth:recall:1", "ext": "none", "stack": false, "synth": false, "lme": -0.0041, "val_std": 0.007089815629511478, "pos_loss": [2.8195, 2.6816, 2.6953, 2.8222, 2.6813, 2.6934, 2.8191, 2.6738], "cost": 5, "st_per_s": 2.58, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.564, "kind": null, "ts": 1781834775.9189456}, {"name": "inv_572", "ops": "wadd>interference_cleanup_read", "val": 0.36, "ppl": 1.43, "topo": "loop", "skill": 0.64, "cap": 0.74, "per_task_skill": {"chat": 0.64, "synth:recall:1": 0.768, "wiki": 0.422, "code": 0.699}, "min_skill": 0.64, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.0543, "val_std": 0.04861240581294852, "pos_loss": [3.602, 3.694, 3.607, 3.5835, 3.3854, 3.2339, 3.5601, 3.205], "cost": 5, "st_per_s": 3.15, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.36, "kind": null, "ts": 1781834034.8806372}, {"name": "inv_576", "ops": "sparse_key_selection>qnorm>erase>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.599, "wiki": 0.401, "code": 0.58}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.1406, "val_std": 0.04560641131835268, "pos_loss": [3.829, 3.8962, 3.8348, 3.956, 3.815, 3.7571, 4.1731, 3.8333], "cost": 7, "st_per_s": 3.21, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781832913.2022626}, {"name": "inv_570", "ops": "knorm>wgdelta>tq>read2>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.626, "wiki": 0.414, "code": 0.675}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.071, "val_std": 0.04609191558380286, "pos_loss": [3.64, 3.6586, 3.5217, 3.6666, 3.5306, 3.4795, 3.8298, 3.6108], "cost": 12, "st_per_s": 3.09, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781832272.3256161}, {"name": "inv_573", "ops": "wdelta>read2", "val": 0.351, "ppl": 1.42, "topo": "cont", "skill": 0.649, "cap": 0.749, "per_task_skill": {"chat": 0.649, "synth:recall:1": 0.769, "wiki": 0.43, "code": 0.75}, "min_skill": 0.649, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.035, "val_std": 0.048447127765135684, "pos_loss": [3.3771, 3.523, 3.3961, 3.3823, 3.2266, 3.2093, 3.6317, 3.3992], "cost": 5, "st_per_s": 13.84, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.351, "kind": null, "ts": 1781831631.404501}, {"name": "inv_574", "ops": "wdelta>interference_cleanup_read", "val": 0.363, "ppl": 1.44, "topo": "stack", "skill": 0.637, "cap": 0.737, "per_task_skill": {"chat": 0.637, "synth:recall:1": 0.856, "wiki": 0.426, "code": 0.697}, "min_skill": 0.637, "worst_task": "chat", "ext": "none", "stack": true, "synth": false, "lme": -0.4987, "val_std": 0.04652577045931154, "pos_loss": [3.5182, 3.5481, 3.4534, 3.5595, 3.4254, 3.3507, 3.8007, 3.4862], "cost": 6, "st_per_s": 24.95, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.363, "kind": null, "ts": 1781831371.0240695}, {"name": "inv_599", "ops": "ksharp>qnorm>erase>tq>read>read>sparse_key_selection", "val": 0.61, "ppl": 1.84, "topo": "loop", "skill": 0.39, "cap": 0.49, "per_task_skill": {"chat": 0.564, "wiki": 0.39, "synth:recall:1": 0.436, "code": 0.534}, "min_skill": 0.39, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0044, "val_std": 0.061809177537514304, "pos_loss": [5.8382, 5.9736, 5.8759, 6.0847, 6.1078, 5.6815, 5.9221, 5.8858], "cost": 11, "st_per_s": 26.27, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.61, "kind": null, "ts": 1781823424.293969}, {"name": "inv_603", "ops": "ksharp>qnorm>knorm>wadd>wadd>read", "val": 0.577, "ppl": 1.78, "topo": "stack", "skill": 0.42300000000000004, "cap": 0.523, "per_task_skill": {"chat": 0.636, "wiki": 0.423, "synth:recall:1": 0.838, "code": 0.68}, "min_skill": 0.42300000000000004, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4083, "val_std": 0.06327248250755883, "pos_loss": [5.6995, 5.6155, 5.5864, 5.6643, 5.684, 5.3287, 5.6224, 5.5523], "cost": 8, "st_per_s": 31.17, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.577, "kind": null, "ts": 1781823284.0534203}, {"name": "inv_601", "ops": "wdelta>interference_cleanup_read", "val": 0.576, "ppl": 1.78, "topo": "stack", "skill": 0.42399999999999993, "cap": 0.524, "per_task_skill": {"chat": 0.634, "wiki": 0.424, "synth:recall:1": 0.854, "code": 0.671}, "min_skill": 0.42399999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.5272, "val_std": 0.06696165982640347, "pos_loss": [5.6943, 5.6246, 5.5654, 5.6729, 5.7255, 5.3223, 5.6235, 5.492], "cost": 5, "st_per_s": 25.84, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.576, "kind": null, "ts": 1781823163.8572202}, {"name": "inv_598", "ops": "decay>wadd>ksharp>read", "val": 0.583, "ppl": 1.79, "topo": "cont", "skill": 0.41700000000000004, "cap": 0.517, "per_task_skill": {"chat": 0.628, "wiki": 0.417, "synth:recall:1": 0.748, "code": 0.73}, "min_skill": 0.41700000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0488, "val_std": 0.06239656051844768, "pos_loss": [5.7637, 5.6787, 5.6504, 5.7314, 5.7864, 5.3953, 5.6616, 5.6404], "cost": 5, "st_per_s": 17.9, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.583, "kind": null, "ts": 1781823013.5997493}, {"name": "inv_596", "ops": "syn595_w215>read", "val": 0.585, "ppl": 1.79, "topo": "stack", "skill": 0.41500000000000004, "cap": 0.515, "per_task_skill": {"chat": 0.6, "wiki": 0.415, "synth:recall:1": 0.693, "code": 0.608}, "min_skill": 0.41500000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.3833, "val_std": 0.06388047541764774, "pos_loss": [5.7063, 5.7099, 5.6469, 5.8194, 5.8489, 5.471, 5.6367, 5.5659], "cost": 4, "st_per_s": 31.63, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.585, "kind": null, "ts": 1781821169.930307}, {"name": "inv_581", "ops": "channel_retention>wadd>wadd>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.619, "wiki": 0.413, "code": 0.632}, "min_skill": null, "worst_task": "wiki", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.045, "val_std": 0.06734294351578125, "pos_loss": [5.8136, 5.6823, 5.6656, 5.7238, 5.8618, 5.4579, 5.7588, 5.6471], "cost": 6, "st_per_s": 2.31, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781821049.727644}, {"name": "inv_580", "ops": "wdelta>syn579_r201", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.635, "wiki": 0.42, "code": 0.677}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.1099, "val_std": 0.06565292932502562, "pos_loss": [5.7234, 5.659, 5.6299, 5.7067, 5.7563, 5.3739, 5.6345, 5.5281], "cost": 4, "st_per_s": 4.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781819296.6081493}, {"name": "inv_566", "ops": "ntm_erase>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.633, "wiki": 0.416, "code": 0.718}, "min_skill": null, "worst_task": "wiki", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.1245, "val_std": 0.0661372626601812, "pos_loss": [5.7474, 5.7072, 5.6061, 5.7722, 5.8394, 5.4356, 5.6387, 5.5668], "cost": 7, "st_per_s": 1.92, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781818836.008118}, {"name": "inv_565", "ops": "gatev>ksharp>surprise_gated_write>gatev>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"wiki": 0.421, "chat": 0.631, "code": 0.685}, "min_skill": null, "worst_task": "wiki", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.2545, "val_std": 0.06512737613155892, "pos_loss": [5.8002, 5.7439, 5.6057, 5.669, 5.7763, 5.3246, 5.6124, 5.4227], "cost": 12, "st_per_s": 1.67, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781817514.9048126}, {"name": "inv_580", "ops": "wdelta>syn579_r339", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.565, "wiki": 0.394}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.0529, "val_std": 0.0617679576792032, "pos_loss": [5.8354, 5.9487, 5.8734, 6.0437, 6.0885, 5.6086, 5.8711, 5.8072], "cost": 5, "st_per_s": 4.28, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781814245.883155}, {"name": "inv_566", "ops": "surprise_gated_write>sparse_key_selection>read2>surprise_gated_write>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.641, "wiki": 0.409}, "min_skill": null, "worst_task": "wiki", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.1082, "val_std": 0.06350949669284772, "pos_loss": [5.9086, 5.6785, 5.6982, 5.7505, 5.9068, 5.501, 5.74, 5.6306], "cost": 12, "st_per_s": 0.49, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781814185.8103204}, {"name": "inv_565", "ops": "surprise_gated_write>read2>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.647, "wiki": 0.42}, "min_skill": null, "worst_task": "wiki", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.1296, "val_std": 0.06381864563018107, "pos_loss": [5.763, 5.6244, 5.6541, 5.6337, 5.8334, 5.4041, 5.5808, 5.5475], "cost": 9, "st_per_s": 3.27, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781813855.4924529}, {"name": "inv_562", "ops": "wadd>read", "val": 0.592, "ppl": 1.81, "topo": "stack", "skill": 0.4079999999999999, "cap": 0.508, "per_task_skill": {"chat": 0.596, "wiki": 0.408, "synth:recall:1": 0.765}, "min_skill": 0.4079999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3365, "val_std": 0.06210802151026988, "pos_loss": [5.7963, 5.74, 5.7456, 5.8724, 5.8561, 5.4654, 5.7537, 5.6991], "cost": 3, "st_per_s": 33.03, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.592, "kind": null, "ts": 1781811877.2199552}, {"name": "inv_564", "ops": "sparse_key_selection>surprise_gated_write>read2>read2", "val": 0.555, "ppl": 1.74, "topo": "loop", "skill": 0.44500000000000006, "cap": 0.545, "per_task_skill": {"chat": 0.661, "wiki": 0.445, "synth:recall:1": 0.772}, "min_skill": 0.44500000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0015, "val_std": 0.06581780875827008, "pos_loss": [5.4866, 5.44, 5.3712, 5.5288, 5.5502, 5.0939, 5.3904, 5.2449], "cost": 9, "st_per_s": 21.89, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.555, "kind": null, "ts": 1781811827.148529}, {"name": "inv_567", "ops": "decay>wadd>ksharp>read", "val": 0.583, "ppl": 1.79, "topo": "cont", "skill": 0.41700000000000004, "cap": 0.517, "per_task_skill": {"chat": 0.628, "wiki": 0.417, "synth:recall:1": 0.748}, "min_skill": 0.41700000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0494, "val_std": 0.06239656051844768, "pos_loss": [5.7637, 5.6787, 5.6504, 5.7314, 5.7864, 5.3953, 5.6616, 5.6404], "cost": 5, "st_per_s": 18.01, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.583, "kind": null, "ts": 1781811757.027179}, {"name": "inv_554", "ops": "gatev>ksharp>surprise_gated_write>gatev>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.631, "wiki": 0.422}, "min_skill": null, "worst_task": "wiki", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.2442, "val_std": 0.06577658889995895, "pos_loss": [5.78, 5.7207, 5.6119, 5.6646, 5.7853, 5.3291, 5.5909, 5.4215], "cost": 12, "st_per_s": 1.13, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781810472.3886821}, {"name": "inv_568", "ops": "syn567_w969>read", "val": 0.597, "ppl": 1.82, "topo": "stack", "skill": 0.403, "cap": 0.503, "per_task_skill": {"chat": 0.584, "wiki": 0.403, "synth:recall:1": 0.706}, "min_skill": 0.403, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.5566, "val_std": 0.06158246831680319, "pos_loss": [5.7953, 5.8836, 5.7793, 5.949, 5.9624, 5.4858, 5.7499, 5.7308], "cost": 5, "st_per_s": 32.54, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.597, "kind": null, "ts": 1781810442.330429}, {"name": "inv_558", "ops": "channel_retention>wadd>wadd>wadd>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.619, "wiki": 0.421}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1646, "val_std": 0.06600329812067007, "pos_loss": [5.7293, 5.6631, 5.5774, 5.7249, 5.7522, 5.4117, 5.5594, 5.5037], "cost": 6, "st_per_s": 3.62, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781809761.2834322}, {"name": "inv_565", "ops": "wadd>read2>read3>knorm", "val": 0.635, "ppl": 1.89, "topo": "stack", "skill": 0.365, "cap": 0.465, "per_task_skill": {"chat": 0.606, "wiki": 0.365, "synth:recall:1": 0.729}, "min_skill": 0.365, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.3861, "val_std": 0.057213163335825185, "pos_loss": [6.3267, 6.0585, 6.0993, 6.2383, 6.2847, 5.9615, 6.1963, 6.0992], "cost": 10, "st_per_s": 27.84, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.635, "kind": null, "ts": 1781809530.936125}, {"name": "inv_556", "ops": "sparse_key_selection>surprise_gated_write>read2>read2>read2", "val": 0.56, "ppl": 1.75, "topo": "loop", "skill": 0.43999999999999995, "cap": 0.54, "per_task_skill": {"chat": 0.659, "wiki": 0.44, "synth:recall:1": 0.769}, "min_skill": 0.43999999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0024, "val_std": 0.06518920591902559, "pos_loss": [5.5449, 5.4543, 5.3977, 5.5512, 5.5894, 5.1007, 5.4676, 5.3458], "cost": 12, "st_per_s": 18.4, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.56, "kind": null, "ts": 1781809460.8321683}, {"name": "inv_560", "ops": "sparse_key_selection>surprise_gated_write>read2>read2", "val": 0.555, "ppl": 1.74, "topo": "loop", "skill": 0.44500000000000006, "cap": 0.545, "per_task_skill": {"chat": 0.661, "wiki": 0.445, "synth:recall:1": 0.768}, "min_skill": 0.44500000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0077, "val_std": 0.06581780875827008, "pos_loss": [5.4866, 5.44, 5.3712, 5.5288, 5.5502, 5.0939, 5.3904, 5.2449], "cost": 9, "st_per_s": 21.84, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.555, "kind": null, "ts": 1781809380.6964934}, {"name": "inv_559", "ops": "surprise_gated_write>treadr", "val": 0.567, "ppl": 1.76, "topo": "loop", "skill": 0.43300000000000005, "cap": 0.533, "per_task_skill": {"chat": 0.64, "wiki": 0.433, "synth:recall:1": 0.765}, "min_skill": 0.43300000000000005, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1096, "val_std": 0.0672295889054257, "pos_loss": [5.5061, 5.5148, 5.4573, 5.6416, 5.7209, 5.2945, 5.4466, 5.4393], "cost": 6, "st_per_s": 24.45, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.567, "kind": null, "ts": 1781809320.5863729}, {"name": "inv_553", "ops": "decay>decay>sparse_key_selection>decay>ksharp>read", "val": 0.575, "ppl": 1.78, "topo": "stack", "skill": 0.42500000000000004, "cap": 0.525, "per_task_skill": {"chat": 0.633, "wiki": 0.425, "synth:recall:1": 0.714}, "min_skill": 0.42500000000000004, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.405, "val_std": 0.06594146833320341, "pos_loss": [5.7043, 5.6435, 5.5718, 5.6175, 5.7011, 5.2915, 5.556, 5.5126], "cost": 8, "st_per_s": 10.8, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.575, "kind": null, "ts": 1781809230.4472148}, {"name": "inv_564", "ops": "decay>decay>wadd>sparse_key_selection>treadr>read>sparse_key_selection", "val": 0.578, "ppl": 1.78, "topo": "loop", "skill": 0.42199999999999993, "cap": 0.522, "per_task_skill": {"chat": 0.628, "wiki": 0.422, "synth:recall:1": 0.753}, "min_skill": 0.42199999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.2045, "val_std": 0.06691013500351457, "pos_loss": [5.6652, 5.6751, 5.5674, 5.7215, 5.7047, 5.4042, 5.6015, 5.5352], "cost": 11, "st_per_s": 24.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.578, "kind": null, "ts": 1781809220.4267552}, {"name": "inv_563", "ops": "decay>wadd>sparse_key_selection>read", "val": 0.584, "ppl": 1.79, "topo": "cont", "skill": 0.4159999999999999, "cap": 0.516, "per_task_skill": {"chat": 0.628, "wiki": 0.416, "synth:recall:1": 0.746}, "min_skill": 0.4159999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0433, "val_std": 0.061974056970758765, "pos_loss": [5.7785, 5.6984, 5.6496, 5.7229, 5.7885, 5.3959, 5.67, 5.6324], "cost": 5, "st_per_s": 17.52, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.584, "kind": null, "ts": 1781809000.0547884}, {"name": "inv_561", "ops": "ksharp>knorm>wadd>wadd>read", "val": 0.571, "ppl": 1.77, "topo": "stack", "skill": 0.42900000000000005, "cap": 0.529, "per_task_skill": {"wiki": 0.429, "chat": 0.638, "synth:recall:1": 0.737}, "min_skill": 0.42900000000000005, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4507, "val_std": 0.06608573783729231, "pos_loss": [5.6617, 5.6077, 5.5355, 5.6081, 5.6462, 5.275, 5.533, 5.4749], "cost": 7, "st_per_s": 31.73, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.571, "kind": null, "ts": 1781808919.920443}, {"name": "inv_587", "ops": "wdelta>syn586_r903", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.629, "wiki": 0.413}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.0825, "val_std": 0.06511707116698115, "pos_loss": [5.7983, 5.7024, 5.6976, 5.7794, 5.8004, 5.4532, 5.7371, 5.5987], "cost": 4, "st_per_s": 3.25, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781806894.808881}, {"name": "inv_577", "ops": "erase>sparse_key_selection>read2>read2", "val": 0.611, "ppl": 1.84, "topo": "loop", "skill": 0.389, "cap": 0.489, "per_task_skill": {"chat": 0.564, "wiki": 0.389, "synth:recall:1": 0.436}, "min_skill": 0.389, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0057, "val_std": 0.06032526263831423, "pos_loss": [5.9214, 5.9632, 5.8698, 6.065, 6.1462, 5.674, 5.9523, 5.8609], "cost": 9, "st_per_s": 23.47, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.611, "kind": null, "ts": 1781806644.3979914}, {"name": "inv_582", "ops": "ksharp>knorm>wadd>wadd>read", "val": 0.571, "ppl": 1.77, "topo": "stack", "skill": 0.42900000000000005, "cap": 0.529, "per_task_skill": {"chat": 0.638, "wiki": 0.429, "synth:recall:1": 0.737}, "min_skill": 0.42900000000000005, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4525, "val_std": 0.06608573783729231, "pos_loss": [5.6617, 5.6077, 5.5355, 5.6081, 5.6462, 5.275, 5.533, 5.4749], "cost": 7, "st_per_s": 31.72, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.571, "kind": null, "ts": 1781806584.3079052}, {"name": "inv_576", "ops": "sparse_key_selection>surprise_gated_write>treadr>treadr>interference_cleanup_read", "val": 0.56, "ppl": 1.75, "topo": "loop", "skill": 0.43999999999999995, "cap": 0.54, "per_task_skill": {"chat": 0.65, "wiki": 0.44, "synth:recall:1": 0.765}, "min_skill": 0.43999999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0238, "val_std": 0.06834252507982576, "pos_loss": [5.5235, 5.5026, 5.4279, 5.4978, 5.6299, 5.1552, 5.3527, 5.3883], "cost": 14, "st_per_s": 17.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.56, "kind": null, "ts": 1781806524.210585}, {"name": "inv_578", "ops": "wdelta>read2", "val": 0.57, "ppl": 1.77, "topo": "cont", "skill": 0.42999999999999994, "cap": 0.53, "per_task_skill": {"wiki": 0.43, "chat": 0.649, "synth:recall:1": 0.77}, "min_skill": 0.42999999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0333, "val_std": 0.06658037613702567, "pos_loss": [5.6017, 5.5786, 5.5299, 5.659, 5.7291, 5.2547, 5.4972, 5.4173], "cost": 5, "st_per_s": 15.63, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.57, "kind": null, "ts": 1781806444.0591693}, {"name": "inv_571", "ops": "syn570_w239>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"wiki": 0.392}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.0527, "val_std": 0.060995085335869816, "pos_loss": [5.8867, 5.9534, 5.8702, 6.0459, 6.0973, 5.6403, 5.8972, 5.8375], "cost": 4, "st_per_s": 4.25, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781805321.2971075}, {"name": "inv_558", "ops": "wgdelta>wgdelta>read", "val": 0.591, "ppl": 1.81, "topo": "stack", "skill": 0.40900000000000003, "cap": 0.509, "per_task_skill": {"chat": 0.599, "wiki": 0.409, "synth:recall:1": 0.563}, "min_skill": 0.40900000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1848, "val_std": 0.06141758888355873, "pos_loss": [5.7554, 5.788, 5.7287, 5.8989, 5.9275, 5.4748, 5.6985, 5.6292], "cost": 8, "st_per_s": 23.45, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.591, "kind": null, "ts": 1781805120.990327}, {"name": "inv_567", "ops": "erase>ksharp>read>read", "val": 0.601, "ppl": 1.82, "topo": "cont", "skill": 0.399, "cap": 0.499, "per_task_skill": {"chat": 0.592, "wiki": 0.399, "synth:recall:1": 0.743}, "min_skill": 0.399, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0392, "val_std": 0.06027373781542534, "pos_loss": [5.8462, 5.8891, 5.8104, 5.9449, 5.9801, 5.5422, 5.8366, 5.7884], "cost": 7, "st_per_s": 15.21, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.601, "kind": null, "ts": 1781805050.8721578}, {"name": "inv_566", "ops": "wadd>read2>read3", "val": 0.635, "ppl": 1.89, "topo": "stack", "skill": 0.365, "cap": 0.465, "per_task_skill": {"chat": 0.606, "wiki": 0.365, "synth:recall:1": 0.731}, "min_skill": 0.365, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.3756, "val_std": 0.057213163335825185, "pos_loss": [6.3267, 6.0585, 6.0993, 6.2383, 6.2847, 5.9615, 6.1963, 6.0992], "cost": 9, "st_per_s": 28.32, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.635, "kind": null, "ts": 1781804930.7040246}, {"name": "inv_565", "ops": "wadd>read", "val": 0.591, "ppl": 1.81, "topo": "stack", "skill": 0.40900000000000003, "cap": 0.509, "per_task_skill": {"chat": 0.596, "wiki": 0.409, "synth:recall:1": 0.766}, "min_skill": 0.40900000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.345, "val_std": 0.06205649668738098, "pos_loss": [5.7992, 5.7394, 5.7447, 5.8687, 5.8523, 5.466, 5.7552, 5.7005], "cost": 3, "st_per_s": 35.1, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.591, "kind": null, "ts": 1781804860.6349597}, {"name": "inv_564", "ops": "sparse_key_selection>surprise_gated_write>read2", "val": 0.553, "ppl": 1.74, "topo": "loop", "skill": 0.44700000000000006, "cap": 0.547, "per_task_skill": {"chat": 0.66, "wiki": 0.447, "synth:recall:1": 0.771}, "min_skill": 0.44700000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0003, "val_std": 0.06931119175013692, "pos_loss": [5.4595, 5.4085, 5.2989, 5.4877, 5.5295, 5.0427, 5.334, 5.3066], "cost": 6, "st_per_s": 17.89, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.553, "kind": null, "ts": 1781804820.5671415}, {"name": "inv_555", "ops": "syn554_w377>read", "val": 0.605, "ppl": 1.83, "topo": "stack", "skill": 0.395, "cap": 0.495, "per_task_skill": {"chat": 0.581, "wiki": 0.395, "synth:recall:1": 0.512}, "min_skill": 0.395, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.2029, "val_std": 0.06091264561924759, "pos_loss": [5.9108, 5.8898, 5.8658, 5.9695, 6.0702, 5.59, 5.8665, 5.7889], "cost": 4, "st_per_s": 32.35, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.605, "kind": null, "ts": 1781803928.7535627}, {"name": "inv_548", "ops": "wdelta>treadr", "val": 0.585, "ppl": 1.79, "topo": "stack", "skill": 0.41500000000000004, "cap": 0.515, "per_task_skill": {"chat": 0.613, "wiki": 0.415, "synth:recall:1": 0.571}, "min_skill": 0.41500000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1596, "val_std": 0.06121148959200316, "pos_loss": [5.7141, 5.7265, 5.6115, 5.7806, 5.8707, 5.4166, 5.6575, 5.614], "cost": 6, "st_per_s": 25.58, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.585, "kind": null, "ts": 1781803888.6727824}, {"name": "inv_546", "ops": "sparse_key_selection>knorm>wadd>wadd>read>interference_cleanup_read", "val": 0.58, "ppl": 1.79, "topo": "stack", "skill": 0.41999999999999993, "cap": 0.52, "per_task_skill": {"chat": 0.633, "wiki": 0.42, "synth:recall:1": 0.76}, "min_skill": 0.41999999999999993, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.3891, "val_std": 0.06354041158658107, "pos_loss": [5.7651, 5.6326, 5.6316, 5.7061, 5.7624, 5.3387, 5.6352, 5.5524], "cost": 10, "st_per_s": 26.24, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.58, "kind": null, "ts": 1781803828.5826936}, {"name": "inv_551", "ops": "wdelta>read>read2", "val": 0.575, "ppl": 1.78, "topo": "stack", "skill": 0.42500000000000004, "cap": 0.525, "per_task_skill": {"wiki": 0.425, "chat": 0.633, "synth:recall:1": 0.744}, "min_skill": 0.42500000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3971, "val_std": 0.06635366691631454, "pos_loss": [5.7037, 5.6475, 5.5152, 5.6966, 5.7101, 5.3049, 5.577, 5.4487], "cost": 7, "st_per_s": 25.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.575, "kind": null, "ts": 1781803758.5115776}, {"name": "inv_573", "ops": "syn572_w607>read", "val": 0.572, "ppl": 1.77, "topo": "stack", "skill": 0.42799999999999994, "cap": 0.528, "per_task_skill": {"chat": 0.609, "wiki": 0.428, "synth:recall:1": 0.533}, "min_skill": 0.42799999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.1913, "val_std": 0.058439454120580804, "pos_loss": [5.6489, 5.2229, 5.4166, 5.5337, 5.5289, 5.6506, 5.6854, 5.7112], "cost": 3, "st_per_s": 14.18, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.572, "kind": null, "ts": 1781802538.4621036}, {"name": "inv_561", "ops": "ksharp>qnorm>erase>gatev>tq>read>read", "val": 0.595, "ppl": 1.81, "topo": "loop", "skill": 0.405, "cap": 0.505, "per_task_skill": {"chat": 0.563, "wiki": 0.405, "synth:recall:1": 0.436}, "min_skill": 0.405, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.005, "val_std": 0.05586321297613622, "pos_loss": [5.725, 5.4399, 5.6491, 5.8122, 5.7655, 5.9443, 5.9111, 5.921], "cost": 12, "st_per_s": 13.57, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.595, "kind": null, "ts": 1781802468.394058}, {"name": "inv_563", "ops": "sparse_key_selection>surprise_gated_write>read2>treadr", "val": 0.547, "ppl": 1.73, "topo": "loop", "skill": 0.45300000000000007, "cap": 0.553, "per_task_skill": {"chat": 0.66, "wiki": 0.453, "synth:recall:1": 0.771}, "min_skill": 0.45300000000000007, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0124, "val_std": 0.06219046122689211, "pos_loss": [5.4501, 4.9878, 5.1552, 5.3529, 5.245, 5.4021, 5.4138, 5.4244], "cost": 10, "st_per_s": 9.21, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.547, "kind": null, "ts": 1781802388.2799044}, {"name": "inv_549", "ops": "householder>read", "val": 0.565, "ppl": 1.76, "topo": "stack", "skill": 0.43500000000000005, "cap": 0.535, "per_task_skill": {"chat": 0.623, "wiki": 0.435, "synth:recall:1": 0.741}, "min_skill": 0.43500000000000005, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4017, "val_std": 0.057924205891691886, "pos_loss": [5.5766, 5.1296, 5.2933, 5.4892, 5.4909, 5.6085, 5.604, 5.6697], "cost": 5, "st_per_s": 3.29, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.565, "kind": null, "ts": 1781800605.1269736}, {"name": "inv_551", "ops": "erase>read", "val": 0.593, "ppl": 1.81, "topo": "stack", "skill": 0.40700000000000003, "cap": 0.507, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.436, "wiki": 0.407}, "min_skill": 0.40700000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0053, "val_std": 0.055162475384847295, "pos_loss": [5.7355, 5.4359, 5.6321, 5.8017, 5.7326, 5.9278, 5.8673, 5.904], "cost": 4, "st_per_s": 12.87, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.593, "kind": null, "ts": 1781800324.7760286}, {"name": "inv_547", "ops": "wadd>read2>read3", "val": 0.63, "ppl": 1.88, "topo": "stack", "skill": 0.37, "cap": 0.47, "per_task_skill": {"chat": 0.606, "wiki": 0.37, "synth:recall:1": 0.73}, "min_skill": 0.37, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.3739, "val_std": 0.05343124133578054, "pos_loss": [6.3938, 5.8264, 5.9866, 6.0564, 6.0725, 6.2233, 6.2266, 6.1681], "cost": 9, "st_per_s": 14.49, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.63, "kind": null, "ts": 1781800254.667059}, {"name": "inv_552", "ops": "decay>wadd>ksharp>read>read", "val": 0.566, "ppl": 1.76, "topo": "cont", "skill": 0.43399999999999994, "cap": 0.534, "per_task_skill": {"chat": 0.626, "synth:recall:1": 0.748, "wiki": 0.434}, "min_skill": 0.43399999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0479, "val_std": 0.059820319374003096, "pos_loss": [5.6319, 5.1805, 5.311, 5.4899, 5.4822, 5.6063, 5.5908, 5.6416], "cost": 7, "st_per_s": 6.88, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.566, "kind": null, "ts": 1781800174.5405183}, {"name": "inv_544", "ops": "wadd>wadd>read", "val": 0.582, "ppl": 1.79, "topo": "stack", "skill": 0.4179999999999999, "cap": 0.518, "per_task_skill": {"chat": 0.596, "wiki": 0.418, "synth:recall:1": 0.767}, "min_skill": 0.4179999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3538, "val_std": 0.057274993123291845, "pos_loss": [5.7379, 5.2947, 5.4795, 5.6223, 5.6554, 5.8045, 5.7992, 5.8239], "cost": 4, "st_per_s": 16.79, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.582, "kind": null, "ts": 1781800054.3633687}, {"name": "inv_542", "ops": "syn541_w994>read", "val": 0.585, "ppl": 1.79, "topo": "stack", "skill": 0.41500000000000004, "cap": 0.515, "per_task_skill": {"chat": 0.576, "wiki": 0.415, "synth:recall:1": 0.66}, "min_skill": 0.41500000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.7022, "val_std": 0.0546369221913806, "pos_loss": [5.673, 5.3705, 5.5512, 5.7043, 5.6488, 5.8381, 5.7922, 5.8487], "cost": 4, "st_per_s": 14.52, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.585, "kind": null, "ts": 1781799112.3703096}, {"name": "inv_527", "ops": "wadd>read2>read3", "val": 0.63, "ppl": 1.88, "topo": "stack", "skill": 0.37, "cap": 0.47, "per_task_skill": {"chat": 0.606, "wiki": 0.37, "synth:recall:1": 0.732}, "min_skill": 0.37, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.3719, "val_std": 0.05343124133578054, "pos_loss": [6.3938, 5.8264, 5.9866, 6.0564, 6.0725, 6.2233, 6.2266, 6.1681], "cost": 9, "st_per_s": 14.7, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.63, "kind": null, "ts": 1781799022.245649}, {"name": "inv_536", "ops": "wadd>ksharp>read2>tq", "val": 0.584, "ppl": 1.79, "topo": "loop", "skill": 0.4159999999999999, "cap": 0.516, "per_task_skill": {"chat": 0.597, "wiki": 0.416, "synth:recall:1": 0.726}, "min_skill": 0.4159999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1569, "val_std": 0.057058588867158505, "pos_loss": [5.6986, 5.3404, 5.5548, 5.6442, 5.6792, 5.7748, 5.8262, 5.8547], "cost": 7, "st_per_s": 12.61, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.584, "kind": null, "ts": 1781798952.138342}, {"name": "inv_533", "ops": "ksharp>knorm>wadd>wadd>read", "val": 0.57, "ppl": 1.77, "topo": "loop", "skill": 0.42999999999999994, "cap": 0.53, "per_task_skill": {"chat": 0.616, "wiki": 0.43, "synth:recall:1": 0.754}, "min_skill": 0.42999999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1023, "val_std": 0.06177826264378097, "pos_loss": [5.5836, 5.2557, 5.3628, 5.5005, 5.5047, 5.6197, 5.6783, 5.7498], "cost": 6, "st_per_s": 15.18, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.57, "kind": null, "ts": 1781798872.0263166}, {"name": "inv_530", "ops": "wdelta>read2", "val": 0.565, "ppl": 1.76, "topo": "cont", "skill": 0.43500000000000005, "cap": 0.535, "per_task_skill": {"chat": 0.649, "wiki": 0.435, "synth:recall:1": 0.77}, "min_skill": 0.43500000000000005, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0327, "val_std": 0.05937720589715863, "pos_loss": [5.6586, 5.1245, 5.2576, 5.4996, 5.5027, 5.5859, 5.5858, 5.6334], "cost": 5, "st_per_s": 6.38, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.565, "kind": null, "ts": 1781798801.8954844}, {"name": "inv_698", "ops": "surprise_gated_write>surprise_gated_write>tq>sparse_key_selection>tq>softnorm_read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.635, "wiki": 0.448}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": 0.2285, "val_std": 0.06236564562471433, "pos_loss": [5.5315, 4.9996, 5.1778, 5.3555, 5.32, 5.4786, 5.4794, 5.5087], "cost": 12, "st_per_s": 1.84, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781796986.2187848}, {"name": "inv_696", "ops": "surprise_gated_write>tq>sparse_key_selection>tq>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.638, "wiki": 0.451}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": 0.234, "val_std": 0.06452968818604778, "pos_loss": [5.4599, 4.9647, 5.1623, 5.3454, 5.3123, 5.4742, 5.4488, 5.4438], "cost": 10, "st_per_s": 2.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781796025.2019904}, {"name": "inv_682", "ops": "sparse_key_selection>ntm_erase>read2>read2>read2>read3>gate_read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.615, "wiki": 0.378}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1156, "val_std": 0.055244915101469526, "pos_loss": [6.4685, 5.7925, 5.9124, 5.9764, 5.9912, 6.0863, 6.0224, 6.0074], "cost": 19, "st_per_s": 0.74, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781794570.9043992}, {"name": "inv_687", "ops": "sparse_key_selection>surprise_gated_write>read2>read2>read2", "val": 0.588, "ppl": 1.8, "topo": "loop", "skill": 0.4119999999999999, "cap": 0.512, "per_task_skill": {"chat": 0.577, "wiki": 0.412, "synth:recall:1": 0.566}, "min_skill": 0.4119999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0607, "val_std": 0.054935766164136174, "pos_loss": [5.6851, 5.3903, 5.5636, 5.739, 5.7079, 5.8513, 5.8333, 5.8886], "cost": 12, "st_per_s": 10.56, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.588, "kind": null, "ts": 1781793489.4462924}, {"name": "inv_681", "ops": "sparse_key_selection>surprise_gated_write>read2>read2>read2>treadr", "val": 0.571, "ppl": 1.77, "topo": "loop", "skill": 0.42900000000000005, "cap": 0.529, "per_task_skill": {"chat": 0.603, "synth:recall:1": 0.578, "wiki": 0.429}, "min_skill": 0.42900000000000005, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.013, "val_std": 0.054678142049691715, "pos_loss": [5.6021, 5.2196, 5.4023, 5.5419, 5.5184, 5.6583, 5.7024, 5.7215], "cost": 16, "st_per_s": 6.82, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.571, "kind": null, "ts": 1781793399.3083975}, {"name": "inv_686", "ops": "tq>surprise_gated_write>read2>read2>treadr>read3", "val": 0.571, "ppl": 1.77, "topo": "loop", "skill": 0.42900000000000005, "cap": 0.529, "per_task_skill": {"chat": 0.62, "wiki": 0.429, "synth:recall:1": 0.767}, "min_skill": 0.42900000000000005, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0447, "val_std": 0.05793451085626967, "pos_loss": [5.5882, 5.2276, 5.3707, 5.4928, 5.5072, 5.6768, 5.7188, 5.718], "cost": 18, "st_per_s": 8.04, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.571, "kind": null, "ts": 1781793279.1137438}, {"name": "inv_668", "ops": "wdelta>surprise_gated_write>interference_cleanup_read>treadr", "val": null, "ppl": null, "topo": "cont", "skill": null, "cap": null, "per_task_skill": {"chat": 0.647}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.0783, "val_std": 0.04733150094239908, "pos_loss": [3.398, 3.4652, 3.3737, 3.5144, 3.3218, 3.2735, 3.6059, 3.4138], "cost": 12, "st_per_s": 0.16, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781792797.4676626}, {"name": "inv_680", "ops": "syn679_p240>wdelta>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "wiki": 0.407}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": 0.3006, "val_std": 0.055162475384847295, "pos_loss": [5.7343, 5.4356, 5.6311, 5.8006, 5.7316, 5.9281, 5.8677, 5.9034], "cost": 5, "st_per_s": 1.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781791485.6487007}, {"name": "inv_669", "ops": "sparse_key_selection>surprise_gated_write>treadr>sparse_key_selection>treadr>sparse_key_selection>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.65, "wiki": 0.454}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.2456, "val_std": 0.06306638321600326, "pos_loss": [5.4181, 4.962, 5.1486, 5.3068, 5.279, 5.4286, 5.4419, 5.4294], "cost": 16, "st_per_s": 0.78, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781790514.3105795}, {"name": "inv_666", "ops": "wdelta>surprise_gated_write>knorm>read>gatev", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.639}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.0545, "val_std": 0.04651544058132324, "pos_loss": [3.4945, 3.5435, 3.5144, 3.5274, 3.4149, 3.3016, 3.7147, 3.4323], "cost": 10, "st_per_s": 0.6, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781788862.0233047}, {"name": "inv_667", "ops": "wdelta>usage_saturation_norm>surprise_gated_write>interference_cleanup_read>read", "val": null, "ppl": null, "topo": "cont", "skill": null, "cap": null, "per_task_skill": {}, "min_skill": null, "worst_task": null, "ext": "delta_mem", "stack": false, "synth": false, "lme": null, "val_std": null, "pos_loss": null, "cost": 12, "st_per_s": null, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781787820.579469}, {"name": "inv_665", "ops": "wdelta>usage_saturation_norm>surprise_gated_write>interference_cleanup_read>read>read", "val": null, "ppl": null, "topo": "cont", "skill": null, "cap": null, "per_task_skill": {}, "min_skill": null, "worst_task": null, "ext": "delta_mem", "stack": false, "synth": false, "lme": null, "val_std": null, "pos_loss": null, "cost": 14, "st_per_s": null, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781787510.0998223}, {"name": "inv_664", "ops": "syn663_w399>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "wiki": 0.407}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": 0.2999, "val_std": 0.055162475384847295, "pos_loss": [5.7355, 5.4359, 5.6321, 5.8017, 5.7326, 5.9278, 5.8673, 5.904], "cost": 4, "st_per_s": 2.63, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781786818.0988202}, {"name": "inv_651", "ops": "surprise_gated_write>wdelta>read2>gatev>treadr>read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.64}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.0084, "val_std": 0.04708358387067984, "pos_loss": [3.4817, 3.5808, 3.4998, 3.5717, 3.4086, 3.2804, 3.7107, 3.3686], "cost": 16, "st_per_s": 0.4, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781786707.9591105}, {"name": "inv_653", "ops": "wdelta>surprise_gated_write>sparse_key_selection>treadr>ksharp>read>read>read2>qnorm", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.633}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.0156, "val_std": 0.04873636434880814, "pos_loss": [3.5744, 3.5811, 3.6201, 3.6241, 3.5251, 3.3262, 3.7628, 3.4238], "cost": 19, "st_per_s": 1.63, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781786347.4839187}, {"name": "inv_652", "ops": "surprise_gated_write>sparse_key_selection>read2>ksharp>read>read>read2>read3>temp_read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.618}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": -0.2497, "val_std": 0.04458375339751079, "pos_loss": [3.8515, 3.8858, 3.785, 3.7372, 3.6362, 3.457, 3.8066, 3.4314], "cost": 21, "st_per_s": 1.62, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781785526.2818763}, {"name": "inv_650", "ops": "surprise_gated_write>sparse_key_selection>read2>ksharp>read>read>read2>qnorm", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.655, "wiki": 0.442}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.2166, "val_std": 0.060500447036136454, "pos_loss": [5.6097, 5.05, 5.1885, 5.4248, 5.3766, 5.5416, 5.5132, 5.5797], "cost": 15, "st_per_s": 2.08, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781784704.9870532}, {"name": "inv_649", "ops": "surprise_gated_write>tq>read2>ksharp>read>read>read2>qnorm", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.655, "wiki": 0.445}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.2216, "val_std": 0.0617164328563143, "pos_loss": [5.5347, 5.0408, 5.2093, 5.3816, 5.3783, 5.4852, 5.4971, 5.5217], "cost": 16, "st_per_s": 1.04, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781784664.921664}, {"name": "inv_637", "ops": "double_delta>novelty_gated_write>sparse_key_selection>read>read>read>ksharp>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.604}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1532, "val_std": 0.04531717473468022, "pos_loss": [3.7295, 3.8619, 3.7828, 3.8885, 3.8367, 3.6694, 4.0548, 3.8429], "cost": 17, "st_per_s": 2.93, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781783542.362989}, {"name": "inv_633", "ops": "double_delta>novelty_gated_write>sparse_key_selection>read>read>read>qnorm>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.603}, "min_skill": null, "worst_task": "chat", "ext": "none", "stack": false, "synth": false, "lme": 0.1543, "val_std": 0.045616741196340974, "pos_loss": [3.734, 3.8683, 3.7879, 3.8983, 3.8415, 3.6703, 4.0626, 3.8484], "cost": 17, "st_per_s": 2.74, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781783542.3612523}, {"name": "inv_636", "ops": "surprise_gated_write>sparse_key_selection>read2>read2>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.563, "wiki": 0.406}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.3383, "val_std": 0.055821993117825104, "pos_loss": [5.7089, 5.4361, 5.647, 5.8035, 5.7521, 5.9235, 5.883, 5.9385], "cost": 12, "st_per_s": 1.76, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781781459.3765824}, {"name": "inv_635", "ops": "double_delta>gatev>novelty_gated_write>sparse_key_selection>read>read>read>ksharp>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.624}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.1539, "val_std": 0.04546179302651645, "pos_loss": [3.5745, 3.6481, 3.5591, 3.7407, 3.5974, 3.4799, 3.9192, 3.6112], "cost": 20, "st_per_s": 0.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781780788.4519053}, {"name": "inv_634", "ops": "sparse_key_selection>double_delta>read2>read2>read2>treadr", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.65, "wiki": 0.423}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.1364, "val_std": 0.05856311369551414, "pos_loss": [5.8256, 5.2796, 5.444, 5.5834, 5.567, 5.7116, 5.7023, 5.6758], "cost": 17, "st_per_s": 1.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781779937.231104}, {"name": "inv_632", "ops": "syn631_w574>read", "val": 0.578, "ppl": 1.78, "topo": "stack", "skill": 0.42199999999999993, "cap": 0.522, "per_task_skill": {"chat": 0.589, "wiki": 0.422, "synth:recall:1": 0.735}, "min_skill": 0.42199999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.4892, "val_std": 0.05559528389711398, "pos_loss": [5.6636, 5.2885, 5.4521, 5.6028, 5.5676, 5.7883, 5.7251, 5.7814], "cost": 3, "st_per_s": 14.81, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.578, "kind": null, "ts": 1781777571.6823301}, {"name": "inv_628", "ops": "wdelta>treadr>treadr", "val": 0.549, "ppl": 1.73, "topo": "stack", "skill": 0.45100000000000007, "cap": 0.551, "per_task_skill": {"chat": 0.635, "wiki": 0.451, "synth:recall:1": 0.725}, "min_skill": 0.45100000000000007, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4064, "val_std": 0.06481822719422557, "pos_loss": [5.4606, 4.9622, 5.1583, 5.3462, 5.3124, 5.4598, 5.4479, 5.4441], "cost": 11, "st_per_s": 11.21, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.549, "kind": null, "ts": 1781777481.5532293}, {"name": "inv_619", "ops": "wadd>sparse_key_selection>read2>read2", "val": 0.639, "ppl": 1.89, "topo": "loop", "skill": 0.361, "cap": 0.461, "per_task_skill": {"chat": 0.582, "wiki": 0.361, "synth:recall:1": 0.755}, "min_skill": 0.361, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0782, "val_std": 0.05226678033849159, "pos_loss": [6.3433, 6.021, 6.0621, 6.1553, 6.1359, 6.2846, 6.3095, 6.2822], "cost": 8, "st_per_s": 10.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.639, "kind": null, "ts": 1781777421.4804885}, {"name": "inv_602", "ops": "surprise_gated_write>sparse_key_selection>read2>read2", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.596}, "min_skill": null, "worst_task": "chat", "ext": "delta_mem", "stack": false, "synth": false, "lme": 0.1458, "val_std": 0.04435649608176815, "pos_loss": [3.8565, 3.9551, 3.8345, 3.9729, 3.8547, 3.7331, 4.1847, 3.9185], "cost": 10, "st_per_s": 2.0, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781775096.2384458}, {"name": "inv_616", "ops": "wdelta>syn615_r024", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.565, "wiki": 0.408}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": 0.2995, "val_std": 0.055214000207736195, "pos_loss": [5.7272, 5.4287, 5.6247, 5.7955, 5.7263, 5.9237, 5.8586, 5.8963], "cost": 4, "st_per_s": 2.45, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781774004.7606966}, {"name": "inv_605", "ops": "surprise_gated_write>sparse_key_selection>surprise_gated_write>read2>read2>treadr>gate_read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.64, "wiki": 0.447}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": 0.2582, "val_std": 0.0631900427909366, "pos_loss": [5.4927, 4.9924, 5.1969, 5.3718, 5.341, 5.4898, 5.4921, 5.5093], "cost": 19, "st_per_s": 2.25, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781773494.0443425}, {"name": "inv_604", "ops": "surprise_gated_write>sparse_key_selection>surprise_gated_write>read2>read2>treadr", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.637, "wiki": 0.448}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": 0.2704, "val_std": 0.0617164328563143, "pos_loss": [5.4991, 5.0053, 5.1864, 5.3176, 5.3372, 5.4803, 5.5261, 5.5191], "cost": 16, "st_per_s": 2.6, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781772923.395094}, {"name": "inv_603", "ops": "qnorm>novelty_gated_write>temp_read>read2", "val": 0.604, "ppl": 1.83, "topo": "stack", "skill": 0.396, "cap": 0.496, "per_task_skill": {"chat": 0.605, "wiki": 0.396, "synth:recall:1": 0.715}, "min_skill": 0.396, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4078, "val_std": 0.05250379452378049, "pos_loss": [5.9904, 5.4956, 5.6651, 5.8525, 5.8844, 6.012, 6.0158, 5.9888], "cost": 9, "st_per_s": 3.17, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.604, "kind": null, "ts": 1781772432.740507}, {"name": "inv_601", "ops": "qnorm>erase>novelty_gated_write>temp_read>read2", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.613, "wiki": 0.427}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": 0.2462, "val_std": 0.05788298603338077, "pos_loss": [5.7026, 5.2009, 5.3877, 5.562, 5.5271, 5.703, 5.671, 5.725], "cost": 11, "st_per_s": 2.26, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781771451.557923}, {"name": "inv_600", "ops": "syn599_w804>read", "val": 0.588, "ppl": 1.8, "topo": "stack", "skill": 0.4119999999999999, "cap": 0.512, "per_task_skill": {"chat": 0.576, "wiki": 0.412, "synth:recall:1": 0.646}, "min_skill": 0.4119999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.6731, "val_std": 0.05364764559191388, "pos_loss": [5.7259, 5.3929, 5.5689, 5.7414, 5.6753, 5.8589, 5.7886, 5.8604], "cost": 3, "st_per_s": 17.04, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.588, "kind": null, "ts": 1781770277.768468}, {"name": "inv_590", "ops": "surprise_gated_write>read2>read>read", "val": 0.547, "ppl": 1.73, "topo": "stack", "skill": 0.45300000000000007, "cap": 0.553, "per_task_skill": {"chat": 0.638, "wiki": 0.453, "synth:recall:1": 0.729}, "min_skill": 0.45300000000000007, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.3928, "val_std": 0.06166490803342541, "pos_loss": [5.4639, 4.9689, 5.1333, 5.3158, 5.3021, 5.436, 5.428, 5.4645], "cost": 10, "st_per_s": 11.96, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.547, "kind": null, "ts": 1781770227.7024264}, {"name": "inv_570", "ops": "ntm_erase>sparse_key_selection>read2>read>sparse_key_selection>treadr>read", "val": null, "ppl": null, "topo": "loop", "skill": null, "cap": null, "per_task_skill": {"chat": 0.594, "wiki": 0.421}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.2881, "val_std": 0.05327666686711387, "pos_loss": [5.6458, 5.2984, 5.4755, 5.6416, 5.612, 5.731, 5.7498, 5.7706], "cost": 15, "st_per_s": 0.91, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781768963.8705022}, {"name": "inv_571", "ops": "tq>wadd>read2>treadr", "val": 0.576, "ppl": 1.78, "topo": "cont", "skill": 0.42399999999999993, "cap": 0.524, "per_task_skill": {"chat": 0.614, "wiki": 0.424, "synth:recall:1": 0.749}, "min_skill": 0.42399999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0166, "val_std": 0.055976567586491784, "pos_loss": [5.6447, 5.2836, 5.4274, 5.5547, 5.581, 5.6919, 5.7264, 5.8004], "cost": 10, "st_per_s": 5.45, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.576, "kind": null, "ts": 1781768072.596323}, {"name": "inv_575", "ops": "wdelta>tq>knorm>treadr>sparse_key_selection>read", "val": 0.558, "ppl": 1.75, "topo": "loop", "skill": 0.44199999999999995, "cap": 0.542, "per_task_skill": {"chat": 0.637, "synth:recall:1": 0.769, "wiki": 0.442}, "min_skill": 0.44199999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0351, "val_std": 0.05979970944484754, "pos_loss": [5.4706, 5.0706, 5.282, 5.4281, 5.4071, 5.5336, 5.5549, 5.5613], "cost": 12, "st_per_s": 9.59, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.558, "kind": null, "ts": 1781767912.361923}, {"name": "inv_580", "ops": "wdelta>tq>knorm>treadr>qnorm>read", "val": 0.558, "ppl": 1.75, "topo": "loop", "skill": 0.44199999999999995, "cap": 0.542, "per_task_skill": {"chat": 0.64, "wiki": 0.442, "synth:recall:1": 0.762}, "min_skill": 0.44199999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1102, "val_std": 0.06084051086720315, "pos_loss": [5.4888, 5.0508, 5.2469, 5.4235, 5.407, 5.5335, 5.5627, 5.5842], "cost": 12, "st_per_s": 11.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.558, "kind": null, "ts": 1781767822.234137}, {"name": "inv_573", "ops": "wdelta>tq>knorm>qnorm>read>treadr", "val": 0.552, "ppl": 1.74, "topo": "cont", "skill": 0.44799999999999995, "cap": 0.548, "per_task_skill": {"chat": 0.651, "wiki": 0.448, "synth:recall:1": 0.771}, "min_skill": 0.44799999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0091, "val_std": 0.06464304279640334, "pos_loss": [5.4813, 5.03, 5.2018, 5.372, 5.3373, 5.5297, 5.4433, 5.4638], "cost": 12, "st_per_s": 5.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.552, "kind": null, "ts": 1781767722.0615056}, {"name": "inv_569", "ops": "syn568_w281>read", "val": 0.566, "ppl": 1.76, "topo": "stack", "skill": 0.43399999999999994, "cap": 0.534, "per_task_skill": {"chat": 0.609, "wiki": 0.434, "synth:recall:1": 0.532}, "min_skill": 0.43399999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.2542, "val_std": 0.059408120790891965, "pos_loss": [5.552, 5.1454, 5.3613, 5.4821, 5.4777, 5.61, 5.6245, 5.6618], "cost": 4, "st_per_s": 17.02, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.566, "kind": null, "ts": 1781766387.7764823}, {"name": "inv_555", "ops": "ksharp>knorm>wadd>read>read2", "val": 0.65, "ppl": 1.92, "topo": "loop", "skill": 0.35, "cap": 0.45, "per_task_skill": {"chat": 0.558, "wiki": 0.35, "synth:recall:1": 0.767}, "min_skill": 0.35, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0596, "val_std": 0.049989383166802584, "pos_loss": [6.4676, 6.125, 6.1754, 6.2976, 6.2441, 6.3755, 6.3524, 6.3768], "cost": 8, "st_per_s": 11.95, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.65, "kind": null, "ts": 1781766337.6994178}, {"name": "inv_554", "ops": "ksharp>knorm>wadd>wadd>read>read2", "val": 0.654, "ppl": 1.92, "topo": "loop", "skill": 0.346, "cap": 0.446, "per_task_skill": {"chat": 0.553, "wiki": 0.346, "synth:recall:1": 0.766}, "min_skill": 0.346, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0616, "val_std": 0.04851577323218029, "pos_loss": [6.5353, 6.1802, 6.1906, 6.3451, 6.3018, 6.407, 6.4132, 6.4334], "cost": 9, "st_per_s": 11.46, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.654, "kind": null, "ts": 1781766247.5771224}, {"name": "inv_556", "ops": "ksharp>knorm>wadd>ksharp>wadd>read>read2", "val": 0.652, "ppl": 1.92, "topo": "loop", "skill": 0.348, "cap": 0.448, "per_task_skill": {"chat": 0.553, "wiki": 0.348, "synth:recall:1": 0.764}, "min_skill": 0.348, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.079, "val_std": 0.051627872534669335, "pos_loss": [6.4933, 6.1613, 6.2072, 6.3296, 6.2671, 6.3976, 6.3485, 6.3938], "cost": 10, "st_per_s": 9.3, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.652, "kind": null, "ts": 1781766167.4601922}, {"name": "inv_546", "ops": "decay>read", "val": 0.591, "ppl": 1.81, "topo": "stack", "skill": 0.40900000000000003, "cap": 0.509, "per_task_skill": {"chat": 0.564, "synth:recall:1": 0.436, "wiki": 0.409}, "min_skill": 0.40900000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0063, "val_std": 0.05336941154831387, "pos_loss": [5.6787, 5.4121, 5.6141, 5.8011, 5.7073, 5.886, 5.8782, 5.8774], "cost": 3, "st_per_s": 0.89, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.591, "kind": null, "ts": 1781763524.2793536}, {"name": "inv_553", "ops": "syn552_w524>read", "val": 0.593, "ppl": 1.81, "topo": "stack", "skill": 0.40700000000000003, "cap": 0.507, "per_task_skill": {"chat": 0.564, "wiki": 0.407, "synth:recall:1": 0.436}, "min_skill": 0.40700000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.0059, "val_std": 0.055162475384847295, "pos_loss": [5.7355, 5.4359, 5.6321, 5.8017, 5.7326, 5.9278, 5.8673, 5.904], "cost": 3, "st_per_s": 14.64, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.593, "kind": null, "ts": 1781763083.6689823}, {"name": "inv_543", "ops": "decay>read>knorm", "val": 0.571, "ppl": 1.77, "topo": "stack", "skill": 0.42900000000000005, "cap": 0.529, "per_task_skill": {"chat": 0.614, "synth:recall:1": 0.716, "wiki": 0.429}, "min_skill": 0.42900000000000005, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4294, "val_std": 0.055090340632802846, "pos_loss": [5.6452, 5.198, 5.3746, 5.5595, 5.4946, 5.6623, 5.6796, 5.7078], "cost": 5, "st_per_s": 4.19, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.571, "kind": null, "ts": 1781762612.9293628}, {"name": "inv_540", "ops": "wadd>read2", "val": 0.633, "ppl": 1.88, "topo": "loop", "skill": 0.367, "cap": 0.467, "per_task_skill": {"chat": 0.593, "wiki": 0.367, "synth:recall:1": 0.757}, "min_skill": 0.367, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0921, "val_std": 0.053049957646402746, "pos_loss": [6.2646, 5.9369, 6.0073, 6.127, 6.091, 6.2362, 6.2552, 6.2559], "cost": 4, "st_per_s": 13.89, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.633, "kind": null, "ts": 1781762412.6815853}, {"name": "inv_544", "ops": "wdelta>temp_read", "val": 0.544, "ppl": 1.72, "topo": "stack", "skill": 0.45599999999999996, "cap": 0.556, "per_task_skill": {"chat": 0.64, "wiki": 0.456, "synth:recall:1": 0.754}, "min_skill": 0.45599999999999996, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4118, "val_std": 0.0631900427909366, "pos_loss": [5.4632, 4.9096, 5.0665, 5.3185, 5.2711, 5.4061, 5.3761, 5.4383], "cost": 5, "st_per_s": 2.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.544, "kind": null, "ts": 1781762332.5250404}, {"name": "inv_537", "ops": "syn536_w640>read", "val": 0.558, "ppl": 1.75, "topo": "stack", "skill": 0.44199999999999995, "cap": 0.542, "per_task_skill": {"chat": 0.619, "wiki": 0.442, "synth:recall:1": 0.792}, "min_skill": 0.44199999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.431, "val_std": 0.061159964769114276, "pos_loss": [5.5224, 5.0692, 5.269, 5.4199, 5.3714, 5.532, 5.5519, 5.563], "cost": 3, "st_per_s": 17.7, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.558, "kind": null, "ts": 1781761177.8957357}, {"name": "inv_531", "ops": "erase>ksharp>read", "val": 0.593, "ppl": 1.81, "topo": "stack", "skill": 0.40700000000000003, "cap": 0.507, "per_task_skill": {"chat": 0.564, "wiki": 0.407, "synth:recall:1": 0.436}, "min_skill": 0.40700000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.006, "val_std": 0.055162475384847295, "pos_loss": [5.7355, 5.4359, 5.6321, 5.8017, 5.7326, 5.9278, 5.8673, 5.904], "cost": 5, "st_per_s": 12.73, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.593, "kind": null, "ts": 1781761127.8439116}, {"name": "inv_533", "ops": "wgdelta>wadd>ksharp>read2>tq", "val": 0.593, "ppl": 1.81, "topo": "loop", "skill": 0.40700000000000003, "cap": 0.507, "per_task_skill": {"chat": 0.577, "wiki": 0.407, "synth:recall:1": 0.436}, "min_skill": 0.40700000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0051, "val_std": 0.05469875197884728, "pos_loss": [5.7076, 5.4531, 5.6415, 5.7759, 5.723, 5.9199, 5.8996, 5.9315], "cost": 10, "st_per_s": 7.85, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.593, "kind": null, "ts": 1781761037.7016141}, {"name": "inv_528", "ops": "surprise_gated_write>treadr", "val": 0.555, "ppl": 1.74, "topo": "loop", "skill": 0.44500000000000006, "cap": 0.545, "per_task_skill": {"chat": 0.641, "wiki": 0.445, "synth:recall:1": 0.765}, "min_skill": 0.44500000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1092, "val_std": 0.05880012788080304, "pos_loss": [5.4714, 5.0331, 5.2358, 5.375, 5.3447, 5.5241, 5.5088, 5.5693], "cost": 6, "st_per_s": 11.73, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.555, "kind": null, "ts": 1781760927.521246}, {"name": "inv_527", "ops": "qnorm>sparse_key_selection>surprise_gated_write>read2>read2>read2", "val": 0.577, "ppl": 1.78, "topo": "loop", "skill": 0.42300000000000004, "cap": 0.523, "per_task_skill": {"chat": 0.655, "wiki": 0.423, "synth:recall:1": 0.769}, "min_skill": 0.42300000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.014, "val_std": 0.060747766186003145, "pos_loss": [5.8398, 5.2996, 5.4147, 5.5891, 5.5596, 5.7624, 5.6392, 5.6724], "cost": 13, "st_per_s": 10.73, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.577, "kind": null, "ts": 1781760867.435114}, {"name": "inv_529", "ops": "sparse_key_selection>surprise_gated_write>read2>read2>read2", "val": 0.56, "ppl": 1.75, "topo": "loop", "skill": 0.43999999999999995, "cap": 0.54, "per_task_skill": {"chat": 0.659, "synth:recall:1": 0.771, "wiki": 0.44}, "min_skill": 0.43999999999999995, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0053, "val_std": 0.062334730730981, "pos_loss": [5.6329, 5.1519, 5.2424, 5.4606, 5.4109, 5.5379, 5.5004, 5.5422], "cost": 12, "st_per_s": 9.67, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.56, "kind": null, "ts": 1781760737.2289855}, {"name": "inv_522", "ops": "surprise_gated_write>treadr>read2", "val": 0.551, "ppl": 1.73, "topo": "loop", "skill": 0.44900000000000007, "cap": 0.549, "per_task_skill": {"chat": 0.656, "wiki": 0.449, "synth:recall:1": 0.771}, "min_skill": 0.44900000000000007, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0037, "val_std": 0.06362285130320329, "pos_loss": [5.4546, 4.9769, 5.1664, 5.3522, 5.3377, 5.4805, 5.4789, 5.5159], "cost": 9, "st_per_s": 9.76, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.551, "kind": null, "ts": 1781760657.070293}, {"name": "inv_516", "ops": "ksharp>knorm>wadd>wadd>read", "val": 0.549, "ppl": 1.73, "topo": "stack", "skill": 0.45100000000000007, "cap": 0.551, "per_task_skill": {"chat": 0.638, "synth:recall:1": 0.737, "wiki": 0.451}, "min_skill": 0.45100000000000007, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4507, "val_std": 0.06288089385360325, "pos_loss": [5.4631, 4.9835, 5.1446, 5.3367, 5.3027, 5.4821, 5.4291, 5.4853], "cost": 7, "st_per_s": 16.93, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.549, "kind": null, "ts": 1781759624.8239088}, {"name": "inv_509", "ops": "decay>wadd>ksharp>read>read", "val": 0.566, "ppl": 1.76, "topo": "cont", "skill": 0.43399999999999994, "cap": 0.534, "per_task_skill": {"chat": 0.626, "wiki": 0.434, "synth:recall:1": 0.748}, "min_skill": 0.43399999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0578, "val_std": 0.059789404480269766, "pos_loss": [5.631, 5.1612, 5.3019, 5.4981, 5.4775, 5.6032, 5.5934, 5.6388], "cost": 7, "st_per_s": 8.28, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.566, "kind": null, "ts": 1781759584.7537315}, {"name": "inv_514", "ops": "wdelta>read2", "val": 0.565, "ppl": 1.76, "topo": "cont", "skill": 0.43500000000000005, "cap": 0.535, "per_task_skill": {"chat": 0.649, "wiki": 0.435, "synth:recall:1": 0.77}, "min_skill": 0.43500000000000005, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.032, "val_std": 0.05937720589715863, "pos_loss": [5.6586, 5.1245, 5.2576, 5.4996, 5.5027, 5.5859, 5.5858, 5.6334], "cost": 5, "st_per_s": 6.36, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.565, "kind": null, "ts": 1781759434.4958506}, {"name": "inv_506", "ops": "wdelta>syn505_r552", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.564, "wiki": 0.407}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": 0.3007, "val_std": 0.05506973070364729, "pos_loss": [5.734, 5.4356, 5.6346, 5.803, 5.7312, 5.9295, 5.8651, 5.9058], "cost": 4, "st_per_s": 2.14, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781758201.9466972}, {"name": "inv_503", "ops": "ksharp>qnorm>erase>tq>read>read>read3", "val": 0.595, "ppl": 1.81, "topo": "loop", "skill": 0.405, "cap": 0.505, "per_task_skill": {"chat": 0.564, "wiki": 0.405, "synth:recall:1": 0.436}, "min_skill": 0.405, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0042, "val_std": 0.054863631412091725, "pos_loss": [5.7355, 5.4671, 5.638, 5.8404, 5.7538, 5.9213, 5.9044, 5.9189], "cost": 14, "st_per_s": 10.73, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.595, "kind": null, "ts": 1781757821.4766715}, {"name": "inv_493", "ops": "knorm>knorm>wadd>wadd>read>interference_cleanup_read", "val": 0.561, "ppl": 1.75, "topo": "stack", "skill": 0.43900000000000006, "cap": 0.539, "per_task_skill": {"chat": 0.636, "wiki": 0.439, "synth:recall:1": 0.751}, "min_skill": 0.43900000000000006, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.362, "val_std": 0.06121148959200316, "pos_loss": [5.6149, 5.0894, 5.235, 5.4514, 5.4305, 5.578, 5.5824, 5.5807], "cost": 10, "st_per_s": 11.03, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.561, "kind": null, "ts": 1781757721.3215063}, {"name": "inv_496", "ops": "wadd>ksharp>read2>tq", "val": 0.584, "ppl": 1.79, "topo": "loop", "skill": 0.4159999999999999, "cap": 0.516, "per_task_skill": {"chat": 0.597, "synth:recall:1": 0.726, "wiki": 0.416}, "min_skill": 0.4159999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1583, "val_std": 0.057058588867158505, "pos_loss": [5.6989, 5.3408, 5.5545, 5.6441, 5.6794, 5.7755, 5.8254, 5.8545], "cost": 7, "st_per_s": 15.16, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.584, "kind": null, "ts": 1781757621.140095}, {"name": "inv_499", "ops": "wdelta>interference_cleanup_read>ksharp", "val": 0.566, "ppl": 1.76, "topo": "loop", "skill": 0.43399999999999994, "cap": 0.534, "per_task_skill": {"chat": 0.635, "wiki": 0.434, "synth:recall:1": 0.758}, "min_skill": 0.43399999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.055, "val_std": 0.05791390092711411, "pos_loss": [5.5718, 5.1866, 5.3406, 5.4699, 5.4598, 5.6088, 5.6001, 5.7142], "cost": 6, "st_per_s": 10.86, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.566, "kind": null, "ts": 1781757561.0399141}, {"name": "inv_492", "ops": "surprise_gated_write>treadr", "val": 0.555, "ppl": 1.74, "topo": "loop", "skill": 0.44500000000000006, "cap": 0.545, "per_task_skill": {"chat": 0.64, "wiki": 0.445, "synth:recall:1": 0.765}, "min_skill": 0.44500000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.1097, "val_std": 0.05880012788080304, "pos_loss": [5.4714, 5.0331, 5.2358, 5.375, 5.3447, 5.5241, 5.5088, 5.5693], "cost": 6, "st_per_s": 11.66, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.555, "kind": null, "ts": 1781756618.9949245}, {"name": "inv_508", "ops": "syn507_w098>read", "val": 0.561, "ppl": 1.75, "topo": "stack", "skill": 0.43900000000000006, "cap": 0.539, "per_task_skill": {"chat": 0.611, "synth:recall:1": 0.712, "wiki": 0.439}, "min_skill": 0.43900000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.4291, "val_std": 0.05841884419142524, "pos_loss": [5.5374, 5.1119, 5.2892, 5.4327, 5.423, 5.5848, 5.5805, 5.618], "cost": 3, "st_per_s": 16.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.561, "kind": null, "ts": 1781755684.9540923}, {"name": "inv_503", "ops": "decay>decay>sparse_key_selection>decay>ksharp>read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.633, "wiki": 0.451}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": 0.2387, "val_std": 0.06123209952115872, "pos_loss": [5.4863, 4.962, 5.1354, 5.357, 5.2867, 5.4558, 5.4665, 5.4593], "cost": 8, "st_per_s": 5.44, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781755634.8748457}, {"name": "inv_502", "ops": "wadd>read3", "val": 0.632, "ppl": 1.88, "topo": "stack", "skill": 0.368, "cap": 0.468, "per_task_skill": {"chat": 0.61, "wiki": 0.368, "synth:recall:1": 0.73}, "min_skill": 0.368, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.43, "val_std": 0.053523986016980545, "pos_loss": [6.4196, 5.8472, 5.9659, 6.089, 6.1274, 6.2194, 6.218, 6.2045], "cost": 6, "st_per_s": 15.9, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.632, "kind": null, "ts": 1781755484.6671133}, {"name": "inv_497", "ops": "ksharp>knorm>wadd>wadd>read", "val": 0.549, "ppl": 1.73, "topo": "stack", "skill": 0.45100000000000007, "cap": 0.551, "per_task_skill": {"chat": 0.638, "synth:recall:1": 0.737, "wiki": 0.451}, "min_skill": 0.45100000000000007, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4517, "val_std": 0.06288089385360325, "pos_loss": [5.4631, 4.9835, 5.1446, 5.3367, 5.3027, 5.4821, 5.4291, 5.4853], "cost": 7, "st_per_s": 16.68, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.549, "kind": null, "ts": 1781755414.5631845}, {"name": "inv_495", "ops": "decay>wadd>ksharp>read", "val": 0.564, "ppl": 1.76, "topo": "cont", "skill": 0.43599999999999994, "cap": 0.536, "per_task_skill": {"chat": 0.628, "wiki": 0.436, "synth:recall:1": 0.748}, "min_skill": 0.43599999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0497, "val_std": 0.06016038320506978, "pos_loss": [5.5998, 5.1428, 5.2952, 5.4742, 5.4665, 5.5883, 5.5926, 5.6485], "cost": 5, "st_per_s": 8.35, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.564, "kind": null, "ts": 1781755364.4836643}, {"name": "inv_496", "ops": "wdelta>read3", "val": 0.617, "ppl": 1.85, "topo": "stack", "skill": 0.383, "cap": 0.483, "per_task_skill": {"chat": 0.609, "wiki": 0.383, "synth:recall:1": 0.737}, "min_skill": 0.383, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.4091, "val_std": 0.056976149150536275, "pos_loss": [6.3307, 5.672, 5.7522, 5.9405, 5.9726, 6.0972, 6.0414, 6.0557], "cost": 6, "st_per_s": 10.42, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.617, "kind": null, "ts": 1781755234.303964}, {"name": "inv_500", "ops": "wadd>ksharp>read", "val": 0.575, "ppl": 1.78, "topo": "cont", "skill": 0.42500000000000004, "cap": 0.525, "per_task_skill": {"chat": 0.648, "wiki": 0.425, "synth:recall:1": 0.773}, "min_skill": 0.42500000000000004, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0407, "val_std": 0.059243241357647504, "pos_loss": [5.7192, 5.2841, 5.4098, 5.5395, 5.541, 5.6927, 5.723, 5.7509], "cost": 4, "st_per_s": 10.03, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.575, "kind": null, "ts": 1781755144.1564338}, {"name": "inv_499", "ops": "wdelta>read2", "val": 0.565, "ppl": 1.76, "topo": "cont", "skill": 0.43500000000000005, "cap": 0.535, "per_task_skill": {"chat": 0.649, "wiki": 0.435, "synth:recall:1": 0.77}, "min_skill": 0.43500000000000005, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.0322, "val_std": 0.05937720589715863, "pos_loss": [5.6586, 5.1245, 5.2576, 5.4996, 5.5027, 5.5859, 5.5858, 5.6334], "cost": 5, "st_per_s": 6.39, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.565, "kind": null, "ts": 1781755044.014417}, {"name": "inv_492", "ops": "syn491_w340>read", "val": 0.555, "ppl": 1.74, "topo": "stack", "skill": 0.44500000000000006, "cap": 0.545, "per_task_skill": {"chat": 0.624, "wiki": 0.445, "synth:recall:1": 0.729}, "min_skill": 0.44500000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.387, "val_std": 0.06469456761929224, "pos_loss": [5.5016, 5.0463, 5.2033, 5.39, 5.4057, 5.5017, 5.4844, 5.5655], "cost": 3, "st_per_s": 16.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.555, "kind": null, "ts": 1781754081.9963484}, {"name": "inv_485", "ops": "erase>read", "val": 0.593, "ppl": 1.81, "topo": "stack", "skill": 0.40700000000000003, "cap": 0.507, "per_task_skill": {"chat": 0.564, "wiki": 0.407, "synth:recall:1": 0.436}, "min_skill": 0.40700000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0059, "val_std": 0.055162475384847295, "pos_loss": [5.7355, 5.4359, 5.6321, 5.8017, 5.7326, 5.9278, 5.8673, 5.904], "cost": 4, "st_per_s": 12.89, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.593, "kind": null, "ts": 1781754021.8933017}, {"name": "inv_481", "ops": "wadd>read>interference_cleanup_read", "val": 0.591, "ppl": 1.81, "topo": "stack", "skill": 0.40900000000000003, "cap": 0.509, "per_task_skill": {"chat": 0.596, "wiki": 0.409, "synth:recall:1": 0.756}, "min_skill": 0.40900000000000003, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3286, "val_std": 0.057079198796314054, "pos_loss": [5.8226, 5.3825, 5.5449, 5.7532, 5.7242, 5.9032, 5.8661, 5.876], "cost": 6, "st_per_s": 14.28, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.591, "kind": null, "ts": 1781753941.752943}, {"name": "inv_489", "ops": "wadd>read", "val": 0.576, "ppl": 1.78, "topo": "stack", "skill": 0.42399999999999993, "cap": 0.524, "per_task_skill": {"chat": 0.596, "wiki": 0.424, "synth:recall:1": 0.766}, "min_skill": 0.42399999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3392, "val_std": 0.05689370943391406, "pos_loss": [5.6566, 5.2539, 5.4289, 5.5651, 5.5774, 5.7306, 5.7307, 5.7624], "cost": 3, "st_per_s": 15.6, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.576, "kind": null, "ts": 1781753861.615563}, {"name": "inv_482", "ops": "sparse_key_selection>surprise_gated_write>interference_cleanup_read", "val": 0.551, "ppl": 1.73, "topo": "loop", "skill": 0.44900000000000007, "cap": 0.549, "per_task_skill": {"chat": 0.645, "wiki": 0.449, "synth:recall:1": 0.766}, "min_skill": 0.44900000000000007, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.044, "val_std": 0.06276753924324768, "pos_loss": [5.4852, 5.0149, 5.1294, 5.3344, 5.3103, 5.5477, 5.4504, 5.5003], "cost": 6, "st_per_s": 12.65, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.551, "kind": null, "ts": 1781753801.5253298}, {"name": "inv_487", "ops": "sparse_key_selection>surprise_gated_write>read2>read2>read2>read2", "val": 0.566, "ppl": 1.76, "topo": "loop", "skill": 0.43399999999999994, "cap": 0.534, "per_task_skill": {"chat": 0.657, "wiki": 0.434, "synth:recall:1": 0.768}, "min_skill": 0.43399999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0114, "val_std": 0.06243778037675878, "pos_loss": [5.7205, 5.1923, 5.3033, 5.5099, 5.4761, 5.63, 5.5153, 5.5707], "cost": 15, "st_per_s": 9.09, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.566, "kind": null, "ts": 1781753701.3615546}, {"name": "inv_479", "ops": "channel_retention>wadd>wadd>wadd>read>softnorm_read", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.624, "wiki": 0.444}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": 0.2585, "val_std": 0.06340644704706994, "pos_loss": [5.5248, 5.0606, 5.2077, 5.3744, 5.3683, 5.5193, 5.5414, 5.5611], "cost": 8, "st_per_s": 0.72, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781751358.776467}, {"name": "inv_477", "ops": "decay>wadd>ksharp>read>read", "val": 0.566, "ppl": 1.76, "topo": "cont", "skill": 0.43399999999999994, "cap": 0.534, "per_task_skill": {"chat": 0.626, "wiki": 0.434, "synth:recall:1": 0.749}, "min_skill": 0.43399999999999994, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0647, "val_std": 0.059820319374003096, "pos_loss": [5.6319, 5.1805, 5.311, 5.4899, 5.4822, 5.6063, 5.5908, 5.6416], "cost": 7, "st_per_s": 6.81, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.566, "kind": null, "ts": 1781750237.3317235}, {"name": "inv_475", "ops": "sparse_key_selection>surprise_gated_write>read2>read2", "val": 0.553, "ppl": 1.74, "topo": "loop", "skill": 0.44700000000000006, "cap": 0.547, "per_task_skill": {"chat": 0.661, "synth:recall:1": 0.771, "wiki": 0.447}, "min_skill": 0.44700000000000006, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.0086, "val_std": 0.062448085341336564, "pos_loss": [5.5513, 5.0644, 5.1737, 5.3851, 5.3609, 5.4849, 5.4615, 5.4837], "cost": 9, "st_per_s": 9.44, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.553, "kind": null, "ts": 1781750097.1476882}, {"name": "inv_501", "ops": "wdelta>syn500_r678", "val": null, "ppl": null, "topo": "stack", "skill": null, "cap": null, "per_task_skill": {"chat": 0.639, "wiki": 0.439}, "min_skill": null, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": 0.205, "val_std": 0.06809520592995909, "pos_loss": [5.6268, 5.1004, 5.2326, 5.4657, 5.4321, 5.5792, 5.5595, 5.5777], "cost": 4, "st_per_s": 1.2, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": null, "kind": null, "ts": 1781748505.1769118}, {"name": "inv_487", "ops": "wadd>read", "val": 0.576, "ppl": 1.78, "topo": "stack", "skill": 0.42399999999999993, "cap": 0.524, "per_task_skill": {"chat": 0.596, "wiki": 0.424, "synth:recall:1": 0.765}, "min_skill": 0.42399999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3361, "val_std": 0.05689370943391406, "pos_loss": [5.6566, 5.2539, 5.4289, 5.5651, 5.5774, 5.7306, 5.7307, 5.7624], "cost": 3, "st_per_s": 15.57, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.576, "kind": null, "ts": 1781747834.3611422}, {"name": "inv_490", "ops": "wdelta>interference_cleanup_read>ksharp", "val": 0.551, "ppl": 1.73, "topo": "stack", "skill": 0.44900000000000007, "cap": 0.549, "per_task_skill": {"chat": 0.637, "wiki": 0.449, "synth:recall:1": 0.856}, "min_skill": 0.44900000000000007, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4981, "val_std": 0.06236564562471433, "pos_loss": [5.4976, 4.9973, 5.1394, 5.3727, 5.3126, 5.4837, 5.4364, 5.5251], "cost": 7, "st_per_s": 15.36, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.551, "kind": null, "ts": 1781747764.260308}, {"name": "inv_485", "ops": "syn484_w891>read", "val": 0.584, "ppl": 1.79, "topo": "stack", "skill": 0.4159999999999999, "cap": 0.516, "per_task_skill": {"chat": 0.583, "wiki": 0.416, "synth:recall:1": 0.726}, "min_skill": 0.4159999999999999, "worst_task": "wiki", "ext": "none", "stack": false, "synth": true, "lme": -0.5996, "val_std": 0.05421441864369169, "pos_loss": [5.7272, 5.3555, 5.5399, 5.6679, 5.631, 5.7927, 5.7778, 5.8588], "cost": 3, "st_per_s": 14.57, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.584, "kind": null, "ts": 1781747493.454451}, {"name": "inv_479", "ops": "knorm>knorm>wadd>wadd>read>interference_cleanup_read", "val": 0.57, "ppl": 1.77, "topo": "stack", "skill": 0.42999999999999994, "cap": 0.53, "per_task_skill": {"chat": 0.631, "wiki": 0.43, "synth:recall:1": 0.741}, "min_skill": 0.42999999999999994, "worst_task": "wiki", "ext": "none", "stack": true, "synth": false, "lme": -0.4121, "val_std": 0.06091264561924759, "pos_loss": [5.6929, 5.1846, 5.3429, 5.5224, 5.533, 5.669, 5.6639, 5.6595], "cost": 10, "st_per_s": 13.39, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.57, "kind": null, "ts": 1781747403.3526504}, {"name": "inv_478", "ops": "wadd>read", "val": 0.576, "ppl": 1.78, "topo": "stack", "skill": 0.42399999999999993, "cap": 0.524, "per_task_skill": {"chat": 0.596, "wiki": 0.424, "synth:recall:1": 0.765}, "min_skill": 0.42399999999999993, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.3366, "val_std": 0.05689370943391406, "pos_loss": [5.6566, 5.2539, 5.4289, 5.5651, 5.5774, 5.7306, 5.7307, 5.7624], "cost": 3, "st_per_s": 15.65, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 800, "seed": null, "params": null, "score": -0.576, "kind": null, "ts": 1781747333.2425878}, {"name": "inv_473", "ops": "wadd>ksharp>read2", "val": 0.535, "ppl": 1.71, "topo": "loop", "skill": 0.4650000000000001, "cap": 0.565, "per_task_skill": {"chat": 0.64, "wiki": 0.465, "synth:recall:1": 0.771}, "min_skill": 0.4650000000000001, "worst_task": "wiki", "ext": "none", "stack": false, "synth": false, "lme": -0.2282, "val_std": 0.052400744878002704, "pos_loss": [5.2193, 4.9588, 5.072, 5.148, 5.1414, 5.3174, 5.2772, 5.3645], "cost": 5, "st_per_s": 12.78, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.535, "kind": null, "ts": 1781745449.4167016}, {"name": "inv_533", "ops": "decay>wadd>ksharp>read2>read2", "val": 0.8371, "ppl": 2.31, "topo": "cont", "skill": 0.827, "cap": 0.927, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": 0.0247, "val_std": 0.05, "pos_loss": [0.7899, 0.8405, 0.8407, 0.8663, 0.8743, 0.807, 0.8608, 0.819], "cost": 9, "st_per_s": 6.37, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8371, "kind": null, "ts": 1781741469.7431011}, {"name": "inv_525", "ops": "syn524_w913>read", "val": 2.752, "ppl": 15.67, "topo": "stack", "skill": 0.433, "cap": 0.533, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": null, "val_std": null, "pos_loss": null, "cost": 3, "st_per_s": 26.75, "pruned": true, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -2.752, "kind": null, "ts": 1781740185.0403242}, {"name": "inv_509", "ops": "syn508_w175>read", "val": 1.1175, "ppl": 3.06, "topo": "stack", "skill": 0.77, "cap": 0.87, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.4745, "val_std": 0.0857, "pos_loss": [1.9549, 1.0071, 1.0016, 1.0393, 0.952, 0.9745, 1.016, 0.997], "cost": 3, "st_per_s": 27.04, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.1175, "kind": null, "ts": 1781739491.210821}, {"name": "inv_471", "ops": "wadd>knorm>sparse_key_selection>knorm>read2", "val": 0.7308, "ppl": 2.08, "topo": "stack", "skill": 0.849, "cap": 0.949, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5429, "val_std": 0.0525, "pos_loss": [1.6337, 0.6491, 0.5661, 0.6376, 0.6106, 0.5545, 0.5994, 0.5976], "cost": 8, "st_per_s": 25.01, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7308, "kind": null, "ts": 1781737354.534651}, {"name": "inv_467", "ops": "wadd>sparse_key_selection>knorm>read2", "val": 0.7212, "ppl": 2.06, "topo": "stack", "skill": 0.851, "cap": 0.951, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5272, "val_std": 0.0496, "pos_loss": [1.62, 0.6254, 0.5571, 0.6265, 0.5964, 0.5523, 0.6001, 0.5908], "cost": 7, "st_per_s": 15.07, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7212, "kind": null, "ts": 1781737324.463275}, {"name": "inv_468", "ops": "wadd>sparse_key_selection>sparse_key_selection>knorm>read2", "val": 0.7393, "ppl": 2.09, "topo": "stack", "skill": 0.848, "cap": 0.948, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5031, "val_std": 0.0647, "pos_loss": [1.628, 0.6257, 0.556, 0.6354, 0.6327, 0.5855, 0.6218, 0.6257], "cost": 8, "st_per_s": 24.29, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7393, "kind": null, "ts": 1781737254.322686}, {"name": "inv_463", "ops": "wadd>sparse_key_selection>sparse_key_selection>knorm>read2", "val": 0.7201, "ppl": 2.05, "topo": "stack", "skill": 0.852, "cap": 0.952, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5223, "val_std": 0.049, "pos_loss": [1.6204, 0.621, 0.5529, 0.6284, 0.594, 0.5468, 0.5972, 0.5996], "cost": 8, "st_per_s": 24.88, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7201, "kind": null, "ts": 1781735826.1748748}, {"name": "inv_473", "ops": "syn472_w225>read", "val": 0.8867, "ppl": 2.43, "topo": "stack", "skill": 0.817, "cap": 0.917, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.496, "val_std": 0.0862, "pos_loss": [1.7259, 0.7667, 0.7674, 0.8111, 0.7746, 0.7429, 0.7697, 0.7308], "cost": 3, "st_per_s": 24.06, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8867, "kind": null, "ts": 1781735826.1740484}, {"name": "inv_461", "ops": "wadd>knorm>sparse_key_selection>knorm>read2", "val": 0.7189, "ppl": 2.05, "topo": "stack", "skill": 0.852, "cap": 0.952, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5221, "val_std": 0.0467, "pos_loss": [1.6191, 0.6169, 0.5508, 0.6261, 0.5974, 0.549, 0.6, 0.5918], "cost": 8, "st_per_s": 14.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7189, "kind": null, "ts": 1781735826.1731339}, {"name": "inv_464", "ops": "wadd>sparse_key_selection>knorm>read2", "val": 0.7181, "ppl": 2.05, "topo": "stack", "skill": 0.852, "cap": 0.952, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5201, "val_std": 0.0463, "pos_loss": [1.6202, 0.6149, 0.545, 0.6213, 0.5932, 0.5531, 0.6008, 0.5941], "cost": 7, "st_per_s": 14.74, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7181, "kind": null, "ts": 1781735485.853728}, {"name": "inv_465", "ops": "wadd>knorm>sparse_key_selection>knorm>treadr", "val": 1.0425, "ppl": 2.84, "topo": "stack", "skill": 0.785, "cap": 0.885, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3902, "val_std": 0.1028, "pos_loss": [1.8282, 0.8772, 0.8751, 0.9843, 0.9405, 0.9118, 0.9602, 0.9648], "cost": 9, "st_per_s": 24.28, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.0425, "kind": null, "ts": 1781735415.7720232}, {"name": "inv_547", "ops": "syn546_w592>read", "val": 0.7785, "ppl": 2.18, "topo": "stack", "skill": 0.84, "cap": 0.94, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.4461, "val_std": 0.0527, "pos_loss": [1.6793, 0.6304, 0.5809, 0.6432, 0.6548, 0.621, 0.6893, 0.7282], "cost": 3, "st_per_s": 26.5, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7785, "kind": null, "ts": 1781734620.188474}, {"name": "inv_535", "ops": "wadd>wadd>treadr", "val": 1.005, "ppl": 2.73, "topo": "cont", "skill": 0.793, "cap": 0.893, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0206, "val_std": 0.0527, "pos_loss": [1.0024, 1.0144, 1.0044, 1.0634, 1.0102, 0.9721, 1.0363, 0.9393], "cost": 6, "st_per_s": 7.04, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.005, "kind": null, "ts": 1781734530.0488863}, {"name": "inv_537", "ops": "decay>wadd>ksharp>read", "val": 0.6569, "ppl": 1.93, "topo": "cont", "skill": 0.865, "cap": 0.965, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0567, "val_std": 0.0593, "pos_loss": [0.7434, 0.6664, 0.6321, 0.6646, 0.6561, 0.5931, 0.6635, 0.6328], "cost": 5, "st_per_s": 9.34, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6569, "kind": null, "ts": 1781734179.5908484}, {"name": "inv_536", "ops": "decay>decay>wadd>treadr>read>sparse_key_selection>interference_cleanup_read", "val": 0.6294, "ppl": 1.88, "topo": "loop", "skill": 0.87, "cap": 0.97, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.1546, "val_std": 0.039, "pos_loss": [0.9052, 0.6009, 0.5642, 0.6031, 0.6039, 0.5599, 0.5894, 0.6074], "cost": 13, "st_per_s": 11.03, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6294, "kind": null, "ts": 1781733919.3427136}, {"name": "inv_539", "ops": "decay>wadd>ksharp>read>read", "val": 0.6338, "ppl": 1.88, "topo": "cont", "skill": 0.869, "cap": 0.969, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0506, "val_std": 0.0546, "pos_loss": [0.7022, 0.6541, 0.5916, 0.624, 0.6377, 0.6056, 0.6319, 0.6233], "cost": 7, "st_per_s": 8.59, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6338, "kind": null, "ts": 1781733689.025565}, {"name": "inv_534", "ops": "wdelta>interference_cleanup_read>sparse_key_selection>sparse_key_selection", "val": 0.6794, "ppl": 1.97, "topo": "stack", "skill": 0.86, "cap": 0.96, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5171, "val_std": 0.0081, "pos_loss": [1.5981, 0.5638, 0.5058, 0.5697, 0.5601, 0.5116, 0.5614, 0.5663], "cost": 8, "st_per_s": 21.07, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6794, "kind": null, "ts": 1781733408.7195554}, {"name": "inv_532", "ops": "wdelta>interference_cleanup_read>sparse_key_selection>ksharp", "val": 0.6787, "ppl": 1.97, "topo": "stack", "skill": 0.86, "cap": 0.96, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.5172, "val_std": 0.0085, "pos_loss": [1.5953, 0.5637, 0.5064, 0.569, 0.5598, 0.5107, 0.561, 0.5636], "cost": 8, "st_per_s": 22.03, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6787, "kind": null, "ts": 1781733288.6207693}, {"name": "inv_521", "ops": "tq>tq>wgdelta>interference_cleanup_read", "val": 1.1973, "ppl": 3.31, "topo": "stack", "skill": 0.753, "cap": 0.853, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3884, "val_std": 0.0337, "pos_loss": [1.9071, 1.0876, 1.0761, 1.1301, 1.0756, 1.088, 1.1306, 1.0873], "cost": 10, "st_per_s": 15.77, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.1973, "kind": null, "ts": 1781732293.020515}, {"name": "inv_505", "ops": "wgdelta>read", "val": 2.1211, "ppl": 8.34, "topo": "loop", "skill": 0.563, "cap": 0.663, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": null, "val_std": null, "pos_loss": null, "cost": 5, "st_per_s": 14.17, "pruned": true, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -2.1211, "kind": null, "ts": 1781731740.2922044}, {"name": "inv_516", "ops": "syn515_w817>read", "val": 1.1406, "ppl": 3.13, "topo": "stack", "skill": 0.765, "cap": 0.865, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.4573, "val_std": 0.1042, "pos_loss": [1.9014, 1.0259, 1.0628, 1.0776, 1.0194, 1.0285, 1.0367, 0.976], "cost": 3, "st_per_s": 27.24, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.1406, "kind": null, "ts": 1781731730.2751591}, {"name": "inv_500", "ops": "syn499_w906>read", "val": 2.75, "ppl": 15.64, "topo": "stack", "skill": 0.433, "cap": 0.533, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": null, "val_std": null, "pos_loss": null, "cost": 3, "st_per_s": 30.07, "pruned": true, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -2.75, "kind": null, "ts": 1781731457.8269618}, {"name": "inv_492", "ops": "wadd>ksharp>tq>tq>read2", "val": 1.0578, "ppl": 2.88, "topo": "loop", "skill": 0.782, "cap": 0.882, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0716, "val_std": 0.0482, "pos_loss": [1.1396, 1.0586, 1.0639, 1.0977, 1.0585, 0.9945, 1.0466, 1.0084], "cost": 9, "st_per_s": 21.97, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.0578, "kind": null, "ts": 1781731407.7778158}, {"name": "inv_484", "ops": "syn483_w215>read", "val": 0.7563, "ppl": 2.13, "topo": "stack", "skill": 0.844, "cap": 0.944, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.4312, "val_std": 0.0676, "pos_loss": [1.6371, 0.6136, 0.5564, 0.6337, 0.6299, 0.5905, 0.6609, 0.7275], "cost": 3, "st_per_s": 26.3, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7563, "kind": null, "ts": 1781731105.3655348}, {"name": "inv_478", "ops": "ksharp>tq>wadd>qnorm>read", "val": 1.1048, "ppl": 3.02, "topo": "loop", "skill": 0.772, "cap": 0.872, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0766, "val_std": 0.0418, "pos_loss": [1.1711, 1.0998, 1.1052, 1.1274, 1.1232, 1.0909, 1.1332, 0.9846], "cost": 7, "st_per_s": 24.02, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.1048, "kind": null, "ts": 1781731005.2462015}, {"name": "inv_475", "ops": "ksharp>gatev>wadd>qnorm>read>gatev", "val": 0.9609, "ppl": 2.61, "topo": "cont", "skill": 0.802, "cap": 0.902, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": 0.0015, "val_std": 0.0865, "pos_loss": [0.9416, 0.9412, 0.9652, 1.009, 0.9802, 0.9616, 1.0121, 0.8738], "cost": 9, "st_per_s": 10.05, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.9609, "kind": null, "ts": 1781730905.1340516}, {"name": "inv_458", "ops": "decay>ksharp>decay>wadd>interference_cleanup_read>ksharp", "val": 1.0397, "ppl": 2.83, "topo": "loop", "skill": 0.786, "cap": 0.886, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.1703, "val_std": 0.0532, "pos_loss": [1.316, 0.9988, 1.0347, 1.0328, 1.0089, 0.9463, 1.0036, 0.9707], "cost": 8, "st_per_s": 13.49, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.0397, "kind": null, "ts": 1781730121.627289}, {"name": "inv_465", "ops": "decay>ksharp>decay>wadd>interference_cleanup_read", "val": 0.9631, "ppl": 2.62, "topo": "cont", "skill": 0.802, "cap": 0.902, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": 0.0142, "val_std": 0.0518, "pos_loss": [0.9984, 0.9255, 0.9446, 1.0177, 0.9756, 0.8937, 0.9864, 0.9659], "cost": 7, "st_per_s": 7.99, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.9631, "kind": null, "ts": 1781730061.5419147}, {"name": "inv_463", "ops": "decay>decay>wadd>interference_cleanup_read>ksharp", "val": 0.6829, "ppl": 1.98, "topo": "loop", "skill": 0.859, "cap": 0.959, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.1598, "val_std": 0.0414, "pos_loss": [0.9911, 0.6118, 0.63, 0.6517, 0.666, 0.6313, 0.6503, 0.633], "cost": 7, "st_per_s": 13.48, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6829, "kind": null, "ts": 1781729941.370192}, {"name": "inv_448", "ops": "wgdelta>gatev>gatev>read2", "val": 1.1257, "ppl": 3.08, "topo": "cont", "skill": 0.768, "cap": 0.868, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": 0.0013, "val_std": 0.0393, "pos_loss": [1.1617, 1.0883, 1.1459, 1.1475, 1.1213, 1.0874, 1.1594, 1.0933], "cost": 10, "st_per_s": 6.82, "pruned": false, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.1257, "kind": null, "ts": 1781728557.05838}, {"name": "inv_446", "ops": "wgdelta>wgdelta>read", "val": 2.1016, "ppl": 8.18, "topo": "stack", "skill": 0.567, "cap": 0.667, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": null, "val_std": null, "pos_loss": null, "cost": 8, "st_per_s": 12.42, "pruned": true, "corpus": "synth:recall:1", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -2.1016, "kind": null, "ts": 1781728406.7856643}, {"name": "inv_448", "ops": "wdelta>treadr", "val": 0.4517, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3087, "val_std": 0.0055, "pos_loss": [0.9966, 0.3864, 0.3466, 0.3815, 0.3854, 0.3513, 0.3868, 0.3788], "cost": 7, "st_per_s": 22.32, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4517, "kind": null, "ts": 1781727466.1719155}, {"name": "inv_496", "ops": "qnorm>channel_retention>channel_retention>wadd>wadd>wadd>read", "val": 0.4516, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3055, "val_std": 0.0059, "pos_loss": [0.9929, 0.3866, 0.3484, 0.3847, 0.3845, 0.3465, 0.3884, 0.38], "cost": 9, "st_per_s": 5.14, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4516, "kind": null, "ts": 1781726938.211791}, {"name": "inv_494", "ops": "syn493_w202>read", "val": 0.6864, "ppl": 1.99, "topo": "stack", "skill": 0.85, "cap": 0.85, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.231, "val_std": 0.0701, "pos_loss": [1.2105, 0.5657, 0.5626, 0.6187, 0.605, 0.6169, 0.6678, 0.6463], "cost": 3, "st_per_s": 24.6, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6864, "kind": null, "ts": 1781725573.7047405}, {"name": "inv_484", "ops": "knorm>tq>wadd>wadd>sparse_key_selection>tq>wadd>wadd>read", "val": 0.6652, "ppl": 1.94, "topo": "stack", "skill": 0.854, "cap": 0.854, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2072, "val_std": 0.0662, "pos_loss": [1.1576, 0.5331, 0.5403, 0.5864, 0.6215, 0.6024, 0.65, 0.6264], "cost": 12, "st_per_s": 13.47, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6652, "kind": null, "ts": 1781725493.5432806}, {"name": "inv_483", "ops": "ksharp>tq>wadd>wadd>sparse_key_selection>tq>wadd>wadd>read", "val": 0.6675, "ppl": 1.95, "topo": "stack", "skill": 0.854, "cap": 0.854, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2162, "val_std": 0.0668, "pos_loss": [1.1662, 0.5585, 0.5301, 0.5974, 0.5932, 0.6013, 0.657, 0.6352], "cost": 12, "st_per_s": 15.0, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6675, "kind": null, "ts": 1781725463.4764397}, {"name": "inv_486", "ops": "ksharp>tq>wadd>wadd>qnorm>tq>wadd>wadd>read", "val": 0.623, "ppl": 1.86, "topo": "stack", "skill": 0.864, "cap": 0.864, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2516, "val_std": 0.055, "pos_loss": [1.1516, 0.5259, 0.4968, 0.562, 0.5367, 0.5346, 0.5859, 0.5884], "cost": 12, "st_per_s": 13.36, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.623, "kind": null, "ts": 1781725313.1993618}, {"name": "inv_485", "ops": "knorm>sparse_key_selection>wadd>wadd>sparse_key_selection>tq>wadd>wadd>read", "val": 0.4661, "ppl": 1.59, "topo": "stack", "skill": 0.898, "cap": 0.898, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2812, "val_std": 0.0202, "pos_loss": [0.9996, 0.3906, 0.3517, 0.3999, 0.396, 0.3627, 0.4131, 0.4148], "cost": 11, "st_per_s": 13.54, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4661, "kind": null, "ts": 1781725303.1656966}, {"name": "inv_467", "ops": "wdelta>wadd>wadd>wadd>wgdelta>read", "val": 0.8368, "ppl": 2.31, "topo": "stack", "skill": 0.817, "cap": 0.817, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.2381, "val_std": 0.037, "pos_loss": [1.2957, 0.7443, 0.7584, 0.8093, 0.7792, 0.7434, 0.7999, 0.7638], "cost": 11, "st_per_s": 7.13, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8368, "kind": null, "ts": 1781724509.8673177}, {"name": "inv_478", "ops": "syn477_w872>read", "val": 0.673, "ppl": 1.96, "topo": "stack", "skill": 0.853, "cap": 0.853, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.2362, "val_std": 0.0607, "pos_loss": [1.2053, 0.5612, 0.5329, 0.6154, 0.5959, 0.5783, 0.6446, 0.6495], "cost": 4, "st_per_s": 14.08, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.673, "kind": null, "ts": 1781724389.6201584}, {"name": "inv_473", "ops": "ksharp>knorm>tq>tq>wadd>wadd>read>knorm", "val": 0.8289, "ppl": 2.29, "topo": "stack", "skill": 0.818, "cap": 0.818, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.2634, "val_std": 0.0376, "pos_loss": [1.3028, 0.758, 0.746, 0.7972, 0.7501, 0.7448, 0.7867, 0.7473], "cost": 12, "st_per_s": 14.18, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8289, "kind": null, "ts": 1781724209.255159}, {"name": "inv_465", "ops": "ksharp>knorm>tq>tq>wadd>wadd>read", "val": 0.8289, "ppl": 2.29, "topo": "stack", "skill": 0.818, "cap": 0.818, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.2636, "val_std": 0.038, "pos_loss": [1.3025, 0.7584, 0.7464, 0.7967, 0.7497, 0.7445, 0.7867, 0.7471], "cost": 11, "st_per_s": 23.84, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8289, "kind": null, "ts": 1781724169.158542}, {"name": "inv_469", "ops": "ksharp>wdelta>knorm>tq>wadd>wadd>read", "val": 0.4545, "ppl": 1.58, "topo": "stack", "skill": 0.9, "cap": 0.9, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3162, "val_std": 0.0092, "pos_loss": [1.0124, 0.3886, 0.3452, 0.3838, 0.3899, 0.3478, 0.3883, 0.3803], "cost": 11, "st_per_s": 12.57, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4545, "kind": null, "ts": 1781724068.9713519}, {"name": "inv_470", "ops": "ksharp>knorm>tq>tq>wadd>wadd>read>interference_cleanup_read", "val": 0.4512, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3069, "val_std": 0.0053, "pos_loss": [0.9949, 0.3874, 0.3468, 0.3803, 0.3861, 0.3465, 0.3838, 0.3848], "cost": 14, "st_per_s": 13.49, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4512, "kind": null, "ts": 1781724038.9074655}, {"name": "inv_458", "ops": "wdelta>interference_cleanup_read", "val": 0.4513, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3064, "val_std": 0.0055, "pos_loss": [0.9985, 0.3838, 0.3478, 0.3799, 0.3829, 0.3475, 0.3873, 0.3822], "cost": 5, "st_per_s": 13.78, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4513, "kind": null, "ts": 1781723195.5251844}, {"name": "inv_446", "ops": "syn445_w310>read", "val": 0.4686, "ppl": 1.6, "topo": "stack", "skill": 0.897, "cap": 0.897, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.3073, "val_std": 0.0492, "pos_loss": [0.9908, 0.4101, 0.3752, 0.3975, 0.4137, 0.3728, 0.4067, 0.3796], "cost": 3, "st_per_s": 14.07, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4686, "kind": null, "ts": 1781722582.4653199}, {"name": "inv_439", "ops": "wgdelta>treadr", "val": 0.835, "ppl": 2.3, "topo": "stack", "skill": 0.817, "cap": 0.817, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.261, "val_std": 0.0418, "pos_loss": [1.33, 0.7455, 0.7461, 0.7944, 0.7571, 0.7527, 0.7954, 0.7581], "cost": 7, "st_per_s": 15.08, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.835, "kind": null, "ts": 1781722492.2850308}, {"name": "inv_440", "ops": "wgdelta>treadr>qnorm", "val": 0.8356, "ppl": 2.31, "topo": "stack", "skill": 0.817, "cap": 0.817, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2612, "val_std": 0.0422, "pos_loss": [1.3302, 0.7464, 0.7473, 0.795, 0.7576, 0.7539, 0.7962, 0.758], "cost": 8, "st_per_s": 13.09, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8356, "kind": null, "ts": 1781722412.1302361}, {"name": "inv_433", "ops": "wdelta>interference_cleanup_read>ksharp", "val": 0.4499, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3081, "val_std": 0.004, "pos_loss": [0.9918, 0.3862, 0.3478, 0.381, 0.3827, 0.3469, 0.3823, 0.3796], "cost": 7, "st_per_s": 22.13, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4499, "kind": null, "ts": 1781722321.9634702}, {"name": "inv_423", "ops": "ksharp>sparse_key_selection>knorm>wadd>wadd>read3", "val": 0.7254, "ppl": 2.07, "topo": "stack", "skill": 0.841, "cap": 0.841, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.1539, "val_std": 0.0513, "pos_loss": [1.1804, 0.575, 0.5842, 0.6795, 0.6671, 0.6712, 0.733, 0.7145], "cost": 10, "st_per_s": 13.97, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7254, "kind": null, "ts": 1781721107.7030869}, {"name": "inv_417", "ops": "wdelta>tq>treadr", "val": 0.4521, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3127, "val_std": 0.0067, "pos_loss": [0.9962, 0.3921, 0.3505, 0.3821, 0.3819, 0.3517, 0.3846, 0.3783], "cost": 8, "st_per_s": 15.92, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4521, "kind": null, "ts": 1781721007.5120704}, {"name": "inv_424", "ops": "wadd>tq>interference_cleanup_read>knorm>read", "val": 0.4586, "ppl": 1.58, "topo": "stack", "skill": 0.9, "cap": 0.9, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2901, "val_std": 0.0157, "pos_loss": [0.999, 0.3873, 0.3475, 0.3872, 0.391, 0.3496, 0.4, 0.4061], "cost": 9, "st_per_s": 13.58, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4586, "kind": null, "ts": 1781720927.3289073}, {"name": "inv_419", "ops": "wdelta>knorm>treadr", "val": 0.4506, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3065, "val_std": 0.0083, "pos_loss": [0.9953, 0.3843, 0.3481, 0.3775, 0.3885, 0.3463, 0.3863, 0.3804], "cost": 7, "st_per_s": 17.01, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4506, "kind": null, "ts": 1781720847.1863317}, {"name": "inv_416", "ops": "wdelta>read3>tq", "val": 0.4526, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3097, "val_std": 0.0065, "pos_loss": [1.0071, 0.3809, 0.3474, 0.3794, 0.3861, 0.3504, 0.3877, 0.381], "cost": 8, "st_per_s": 14.08, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4526, "kind": null, "ts": 1781720706.930021}, {"name": "inv_582", "ops": "syn581_w601>read", "val": 0.6686, "ppl": 1.95, "topo": "stack", "skill": 0.854, "cap": 0.854, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.2309, "val_std": 0.0653, "pos_loss": [1.189, 0.5625, 0.5249, 0.6119, 0.5887, 0.5814, 0.6473, 0.6423], "cost": 3, "st_per_s": 26.02, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6686, "kind": null, "ts": 1781719166.8723154}, {"name": "inv_567", "ops": "wdelta>knorm>treadr>ksharp", "val": 0.4518, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3102, "val_std": 0.0063, "pos_loss": [0.9991, 0.3869, 0.3504, 0.3781, 0.3888, 0.3452, 0.3851, 0.3806], "cost": 8, "st_per_s": 16.81, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4518, "kind": null, "ts": 1781719066.783684}, {"name": "inv_575", "ops": "tq>ksharp>wdelta>knorm>treadr>ksharp", "val": 0.6637, "ppl": 1.94, "topo": "stack", "skill": 0.855, "cap": 0.855, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2257, "val_std": 0.05, "pos_loss": [1.1737, 0.5522, 0.5169, 0.6034, 0.5946, 0.5923, 0.6397, 0.6349], "cost": 11, "st_per_s": 16.92, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6637, "kind": null, "ts": 1781718916.5591202}, {"name": "inv_568", "ops": "ksharp>wdelta>knorm>treadr>ksharp", "val": 0.6475, "ppl": 1.91, "topo": "stack", "skill": 0.858, "cap": 0.858, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2237, "val_std": 0.0565, "pos_loss": [1.1576, 0.5341, 0.5066, 0.5872, 0.5806, 0.5693, 0.6265, 0.6179], "cost": 9, "st_per_s": 17.21, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6475, "kind": null, "ts": 1781718776.3911097}, {"name": "inv_574", "ops": "decay>wadd>sparse_key_selection>treadr>read>sparse_key_selection", "val": 0.519, "ppl": 1.68, "topo": "loop", "skill": 0.886, "cap": 0.886, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0175, "val_std": 0.0231, "pos_loss": [0.5791, 0.4947, 0.483, 0.5384, 0.5328, 0.4865, 0.5411, 0.4977], "cost": 10, "st_per_s": 14.81, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.519, "kind": null, "ts": 1781718626.1171112}, {"name": "inv_573", "ops": "decay>decay>sparse_key_selection>wadd>ksharp>read", "val": 0.4521, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3047, "val_std": 0.0043, "pos_loss": [0.9935, 0.3857, 0.3463, 0.3868, 0.3873, 0.3472, 0.3875, 0.3822], "cost": 8, "st_per_s": 26.93, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4521, "kind": null, "ts": 1781718455.8314357}, {"name": "inv_566", "ops": "syn565_w678>read", "val": 0.7326, "ppl": 2.08, "topo": "stack", "skill": 0.839, "cap": 0.839, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.2362, "val_std": 0.0675, "pos_loss": [1.262, 0.6216, 0.5978, 0.6775, 0.6555, 0.6377, 0.7059, 0.7052], "cost": 3, "st_per_s": 15.01, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7326, "kind": null, "ts": 1781717629.8365777}, {"name": "inv_556", "ops": "ksharp>knorm>wadd>wadd>ksharp>read", "val": 0.7083, "ppl": 2.03, "topo": "stack", "skill": 0.845, "cap": 0.845, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.2031, "val_std": 0.0548, "pos_loss": [1.2023, 0.5808, 0.5918, 0.6339, 0.6386, 0.6419, 0.7008, 0.6761], "cost": 8, "st_per_s": 24.19, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.7083, "kind": null, "ts": 1781717499.5826554}, {"name": "inv_555", "ops": "wadd>sparse_key_selection>read>qnorm", "val": 0.6425, "ppl": 1.9, "topo": "loop", "skill": 0.859, "cap": 0.859, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": 0.0252, "val_std": 0.0656, "pos_loss": [0.6665, 0.61, 0.6128, 0.6631, 0.6368, 0.6233, 0.6844, 0.6425], "cost": 5, "st_per_s": 15.34, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6425, "kind": null, "ts": 1781717459.4919865}, {"name": "inv_560", "ops": "tq>wadd>interference_cleanup_read", "val": 0.4508, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3061, "val_std": 0.006, "pos_loss": [0.9938, 0.384, 0.3459, 0.385, 0.3849, 0.3474, 0.3876, 0.378], "cost": 7, "st_per_s": 24.71, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4508, "kind": null, "ts": 1781717399.3551304}, {"name": "inv_538", "ops": "tq>ksharp>wdelta>interference_cleanup_read>interference_cleanup_read", "val": 0.6315, "ppl": 1.88, "topo": "stack", "skill": 0.862, "cap": 0.862, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2406, "val_std": 0.0744, "pos_loss": [1.1538, 0.5162, 0.4947, 0.5747, 0.5606, 0.5649, 0.6084, 0.5803], "cost": 11, "st_per_s": 13.56, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6315, "kind": null, "ts": 1781716856.375799}, {"name": "inv_550", "ops": "syn549_w259>read", "val": 0.6074, "ppl": 1.84, "topo": "stack", "skill": 0.867, "cap": 0.867, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.2898, "val_std": 0.0312, "pos_loss": [1.1418, 0.5246, 0.5042, 0.5598, 0.5328, 0.5105, 0.5646, 0.5222], "cost": 3, "st_per_s": 24.71, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.6074, "kind": null, "ts": 1781716776.2206936}, {"name": "inv_529", "ops": "decay>decay>wadd>sparse_key_selection>treadr>read>sparse_key_selection>interference_cleanup_read", "val": 0.5047, "ppl": 1.66, "topo": "loop", "skill": 0.889, "cap": 0.889, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0422, "val_std": 0.0414, "pos_loss": [0.5771, 0.4991, 0.4863, 0.5145, 0.5, 0.47, 0.4991, 0.4927], "cost": 14, "st_per_s": 10.81, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.5047, "kind": null, "ts": 1781715692.2130702}, {"name": "inv_526", "ops": "decay>decay>wadd>sparse_key_selection>read>sparse_key_selection>interference_cleanup_read", "val": 0.4412, "ppl": 1.55, "topo": "loop", "skill": 0.903, "cap": 0.903, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.045, "val_std": 0.0421, "pos_loss": [0.5225, 0.4406, 0.3973, 0.4464, 0.4406, 0.4092, 0.4426, 0.4304], "cost": 10, "st_per_s": 13.5, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4412, "kind": null, "ts": 1781715642.12333}, {"name": "inv_490", "ops": "wdelta>ksharp>read", "val": 0.8324, "ppl": 2.3, "topo": "stack", "skill": 0.818, "cap": 0.818, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.2435, "val_std": 0.0425, "pos_loss": [1.2919, 0.7458, 0.7561, 0.7964, 0.7663, 0.7541, 0.7966, 0.7542], "cost": 6, "st_per_s": 14.83, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.8324, "kind": null, "ts": 1781714758.2234445}, {"name": "inv_503", "ops": "syn502_w529>read", "val": 1.79, "ppl": 5.99, "topo": "stack", "skill": 0.608, "cap": 0.608, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.1193, "val_std": 0.027, "pos_loss": [2.0424, 1.701, 1.786, 1.8212, 1.6834, 1.7825, 1.817, 1.6878], "cost": 3, "st_per_s": 26.77, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.79, "kind": null, "ts": 1781714708.1178522}, {"name": "inv_491", "ops": "wadd>read>ksharp", "val": 0.4618, "ppl": 1.59, "topo": "stack", "skill": 0.899, "cap": 0.899, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.2868, "val_std": 0.012, "pos_loss": [1.001, 0.3867, 0.3499, 0.3887, 0.3944, 0.3599, 0.4064, 0.4077], "cost": 4, "st_per_s": 28.68, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4618, "kind": null, "ts": 1781714607.957662}, {"name": "inv_493", "ops": "decay>decay>wadd>sparse_key_selection>treadr>read>sparse_key_selection>interference_cleanup_read", "val": 0.4999, "ppl": 1.65, "topo": "loop", "skill": 0.89, "cap": 0.89, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0437, "val_std": 0.0356, "pos_loss": [0.5719, 0.4934, 0.4777, 0.5213, 0.5012, 0.4557, 0.4888, 0.489], "cost": 14, "st_per_s": 12.77, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4999, "kind": null, "ts": 1781714587.9090996}, {"name": "inv_499", "ops": "decay>wadd>wadd>sparse_key_selection>treadr>read>sparse_key_selection>interference_cleanup_read", "val": 0.4267, "ppl": 1.53, "topo": "loop", "skill": 0.907, "cap": 0.907, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0801, "val_std": 0.0546, "pos_loss": [0.5319, 0.4245, 0.3786, 0.4536, 0.4442, 0.3843, 0.4025, 0.3938], "cost": 14, "st_per_s": 6.86, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4267, "kind": null, "ts": 1781714517.7707188}, {"name": "inv_492", "ops": "decay>wadd>wadd>sparse_key_selection>treadr>read>sparse_key_selection>interference_cleanup_read>treadr", "val": 0.4185, "ppl": 1.52, "topo": "loop", "skill": 0.908, "cap": 0.908, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.0698, "val_std": 0.0248, "pos_loss": [0.5156, 0.4327, 0.3728, 0.4263, 0.4192, 0.3701, 0.4062, 0.4025], "cost": 18, "st_per_s": 7.11, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4185, "kind": null, "ts": 1781714397.5654662}, {"name": "inv_489", "ops": "wdelta>ksharp>treadr", "val": 0.4519, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": true, "synth": false, "lme": -0.3086, "val_std": 0.0054, "pos_loss": [0.9963, 0.3865, 0.3461, 0.3818, 0.385, 0.3513, 0.3872, 0.3784], "cost": 8, "st_per_s": 22.21, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4519, "kind": null, "ts": 1781714167.1817043}, {"name": "inv_487", "ops": "syn486_w226>read", "val": 1.4707, "ppl": 4.35, "topo": "stack", "skill": 0.678, "cap": 0.678, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": true, "lme": -0.3039, "val_std": 0.2134, "pos_loss": [1.9979, 1.394, 1.4119, 1.4603, 1.351, 1.3715, 1.4772, 1.3069], "cost": 4, "st_per_s": 24.21, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -1.4707, "kind": null, "ts": 1781713423.844738}, {"name": "inv_472", "ops": "wdelta>sparse_key_selection>treadr", "val": 0.4535, "ppl": 1.57, "topo": "stack", "skill": 0.901, "cap": 0.901, "per_task_skill": null, "min_skill": null, "worst_task": null, "ext": "none", "stack": false, "synth": false, "lme": -0.3016, "val_std": 0.008, "pos_loss": [0.9999, 0.3812, 0.3523, 0.3811, 0.3908, 0.3453, 0.3894, 0.3884], "cost": 7, "st_per_s": 14.2, "pruned": false, "corpus": "synth:recall:0", "window": 256, "d": 384, "n_layer": null, "steps": 2400, "seed": null, "params": null, "score": -0.4535, "kind": null, "ts": 1781713383.7745948}], "handoff": {"core": "lang_gpt_rag2", "score": 0.398, "discrim": 0.5417, "fix": 0.3191, "behavior": 0.3333, "code_bpc": 3.6309, "diagnosis_match": 0.3784, "fix_match": 0.3514, "target": 0.6, "ready": 0.038}, "handoff_history": [{"ts": 1781808037.844677, "score": 0.4305, "core": "chat"}, {"ts": 1781849688.4742837, "score": 0.4444, "core": "chat"}, {"ts": 1781859448.0068944, "score": 0.375, "core": "lang_gpt_rag2"}, {"ts": 1781859642.973028, "score": 0.4151, "core": "lang_gpt_rag2"}, {"ts": 1781891093.9177508, "score": 0.4321, "core": "current_core"}, {"ts": 1781895316.5914407, "score": 0.4151, "core": "lang_gpt_rag2"}, {"ts": 1781897893.3941567, "score": 0.3904, "core": "lang_gpt_rag2"}, {"ts": 1781906706.8518825, "score": 0.4006, "core": "current_core"}, {"ts": 1781909146.817999, "score": 0.3904, "core": "lang_gpt_rag2"}, {"ts": 1781913270.3438883, "score": 0.398, "core": "lang_gpt_rag2"}], "core_thermo": {"score": 0.3601, "code_bpc": 2.7572, "discrim": 0.5556, "fix": 0.1915, "behavior": 0.3333, "diagnosis_match": 0.2973, "fix_match": 0.1892, "best_static": "lang_gpt_rag2", "best_static_score": 0.398, "leads_static": false, "target": 0.6, "trajectory": [{"ts": 1781841035.6459026, "score": 0.4167, "code_bpc": 3.7354, "champion": "inv_573", "steps": 60}, {"ts": 1781843547.7185411, "score": 0.3264, "code_bpc": 2.4482, "champion": "inv_573", "steps": 1000}, {"ts": 1781857548.0102599, "score": 0.3472, "code_bpc": 2.4482, "champion": "inv_573", "steps": 1000}, {"ts": 1781888278.8988118, "score": 0.3611, "code_bpc": 3.7284, "champion": "inv_573", "steps": 1000}, {"ts": 1781891363.5860374, "score": 0.4321, "code_bpc": 2.7473, "champion": "inv_573", "steps": 1000}, {"ts": 1781892990.5240438, "score": 0.4321, "code_bpc": 2.7473, "champion": "inv_600", "steps": 1000}, {"ts": 1781895721.2081265, "score": 0.3858, "code_bpc": 2.6757, "champion": "inv_600", "steps": 1000}, {"ts": 1781898212.165949, "score": 0.3398, "code_bpc": 2.5571, "champion": "inv_600", "steps": 2000}, {"ts": 1781906376.9948766, "score": 0.4006, "code_bpc": 2.516, "champion": "inv_600", "steps": 2000}, {"ts": 1781908743.0457282, "score": 0.3806, "code_bpc": 2.7018, "champion": "inv_600", "steps": 2000}, {"ts": 1781913653.5889533, "score": 0.3187, "code_bpc": 2.9785, "champion": "inv_600", "steps": 2000}, {"ts": 1781916496.6023736, "score": 0.3601, "code_bpc": 2.7572, "champion": "inv_600", "steps": 2000}]}, "suite": ["chat", "wiki", "synth:recall:1"], "worst_task": "chat", "winners": [{"name": "inv_464", "val_mean": 0.7404}, {"name": "inv_475", "val_mean": 0.4695}, {"name": "inv_560", "val_mean": 0.448}, {"name": "inv_573", "val_mean": 0.24}, {"name": "inv_600", "val_mean": 0.224}]}, "history": [{"ts": 1781755684.9540923, "val": null, "skill": 0.43900000000000006, "cap": 0.539}, {"ts": 1781756618.9949245, "val": null, "skill": 0.44500000000000006, "cap": 0.545}, {"ts": 1781757561.0399141, "val": null, "skill": 0.43399999999999994, "cap": 0.534}, {"ts": 1781757621.140095, "val": null, "skill": 0.4159999999999999, "cap": 0.516}, {"ts": 1781757721.3215063, "val": null, "skill": 0.43900000000000006, "cap": 0.539}, {"ts": 1781757821.4766715, "val": null, "skill": 0.405, "cap": 0.505}, {"ts": 1781759434.4958506, "val": null, "skill": 0.43500000000000005, "cap": 0.535}, {"ts": 1781759584.7537315, "val": null, "skill": 0.43399999999999994, "cap": 0.534}, {"ts": 1781759624.8239088, "val": null, "skill": 0.45100000000000007, "cap": 0.551}, {"ts": 1781760657.070293, "val": null, "skill": 0.44900000000000007, "cap": 0.549}, {"ts": 1781760737.2289855, "val": null, "skill": 0.43999999999999995, "cap": 0.54}, {"ts": 1781760867.435114, "val": null, "skill": 0.42300000000000004, "cap": 0.523}, {"ts": 1781760927.521246, "val": null, "skill": 0.44500000000000006, "cap": 0.545}, {"ts": 1781761037.7016141, "val": null, "skill": 0.40700000000000003, "cap": 0.507}, {"ts": 1781761127.8439116, "val": null, "skill": 0.40700000000000003, "cap": 0.507}, {"ts": 1781761177.8957357, "val": null, "skill": 0.44199999999999995, "cap": 0.542}, {"ts": 1781762332.5250404, "val": null, "skill": 0.45599999999999996, "cap": 0.556}, {"ts": 1781762412.6815853, "val": null, "skill": 0.367, "cap": 0.467}, {"ts": 1781762612.9293628, "val": null, "skill": 0.42900000000000005, "cap": 0.529}, {"ts": 1781763083.6689823, "val": null, "skill": 0.40700000000000003, "cap": 0.507}, {"ts": 1781763524.2793536, "val": null, "skill": 0.40900000000000003, "cap": 0.509}, {"ts": 1781766167.4601922, "val": null, "skill": 0.348, "cap": 0.448}, {"ts": 1781766247.5771224, "val": null, "skill": 0.346, "cap": 0.446}, {"ts": 1781766337.6994178, "val": null, "skill": 0.35, "cap": 0.45}, {"ts": 1781766387.7764823, "val": null, "skill": 0.43399999999999994, "cap": 0.534}, {"ts": 1781767722.0615056, "val": null, "skill": 0.44799999999999995, "cap": 0.548}, {"ts": 1781767822.234137, "val": null, "skill": 0.44199999999999995, "cap": 0.542}, {"ts": 1781767912.361923, "val": null, "skill": 0.44199999999999995, "cap": 0.542}, {"ts": 1781768072.596323, "val": null, "skill": 0.42399999999999993, "cap": 0.524}, {"ts": 1781770227.7024264, "val": null, "skill": 0.45300000000000007, "cap": 0.553}, {"ts": 1781770277.768468, "val": null, "skill": 0.4119999999999999, "cap": 0.512}, {"ts": 1781772432.740507, "val": null, "skill": 0.396, "cap": 0.496}, {"ts": 1781777421.4804885, "val": null, "skill": 0.361, "cap": 0.461}, {"ts": 1781777481.5532293, "val": null, "skill": 0.45100000000000007, "cap": 0.551}, {"ts": 1781777571.6823301, "val": null, "skill": 0.42199999999999993, "cap": 0.522}, {"ts": 1781793279.1137438, "val": null, "skill": 0.42900000000000005, "cap": 0.529}, {"ts": 1781793399.3083975, "val": null, "skill": 0.42900000000000005, "cap": 0.529}, {"ts": 1781793489.4462924, "val": null, "skill": 0.4119999999999999, "cap": 0.512}, {"ts": 1781798801.8954844, "val": null, "skill": 0.43500000000000005, "cap": 0.535}, {"ts": 1781798872.0263166, "val": null, "skill": 0.42999999999999994, "cap": 0.53}, {"ts": 1781798952.138342, "val": null, "skill": 0.4159999999999999, "cap": 0.516}, {"ts": 1781799022.245649, "val": null, "skill": 0.37, "cap": 0.47}, {"ts": 1781799112.3703096, "val": null, "skill": 0.41500000000000004, "cap": 0.515}, {"ts": 1781800054.3633687, "val": null, "skill": 0.4179999999999999, "cap": 0.518}, {"ts": 1781800174.5405183, "val": null, "skill": 0.43399999999999994, "cap": 0.534}, {"ts": 1781800254.667059, "val": null, "skill": 0.37, "cap": 0.47}, {"ts": 1781800324.7760286, "val": null, "skill": 0.40700000000000003, "cap": 0.507}, {"ts": 1781800605.1269736, "val": null, "skill": 0.43500000000000005, "cap": 0.535}, {"ts": 1781802388.2799044, "val": null, "skill": 0.45300000000000007, "cap": 0.553}, {"ts": 1781802468.394058, "val": null, "skill": 0.405, "cap": 0.505}, {"ts": 1781802538.4621036, "val": null, "skill": 0.42799999999999994, "cap": 0.528}, {"ts": 1781803758.5115776, "val": null, "skill": 0.42500000000000004, "cap": 0.525}, {"ts": 1781803828.5826936, "val": null, "skill": 0.41999999999999993, "cap": 0.52}, {"ts": 1781803888.6727824, "val": null, "skill": 0.41500000000000004, "cap": 0.515}, {"ts": 1781803928.7535627, "val": null, "skill": 0.395, "cap": 0.495}, {"ts": 1781804820.5671415, "val": null, "skill": 0.44700000000000006, "cap": 0.547}, {"ts": 1781804860.6349597, "val": null, "skill": 0.40900000000000003, "cap": 0.509}, {"ts": 1781804930.7040246, "val": null, "skill": 0.365, "cap": 0.465}, {"ts": 1781805050.8721578, "val": null, "skill": 0.399, "cap": 0.499}, {"ts": 1781805120.990327, "val": null, "skill": 0.40900000000000003, "cap": 0.509}, {"ts": 1781806444.0591693, "val": null, "skill": 0.42999999999999994, "cap": 0.53}, {"ts": 1781806524.210585, "val": null, "skill": 0.43999999999999995, "cap": 0.54}, {"ts": 1781806584.3079052, "val": null, "skill": 0.42900000000000005, "cap": 0.529}, {"ts": 1781806644.3979914, "val": null, "skill": 0.389, "cap": 0.489}, {"ts": 1781808919.920443, "val": null, "skill": 0.42900000000000005, "cap": 0.529}, {"ts": 1781809000.0547884, "val": null, "skill": 0.4159999999999999, "cap": 0.516}, {"ts": 1781809220.4267552, "val": null, "skill": 0.42199999999999993, "cap": 0.522}, {"ts": 1781809230.4472148, "val": null, "skill": 0.42500000000000004, "cap": 0.525}, {"ts": 1781809320.5863729, "val": null, "skill": 0.43300000000000005, "cap": 0.533}, {"ts": 1781809380.6964934, "val": null, "skill": 0.44500000000000006, "cap": 0.545}, {"ts": 1781809460.8321683, "val": null, "skill": 0.43999999999999995, "cap": 0.54}, {"ts": 1781809530.936125, "val": null, "skill": 0.365, "cap": 0.465}, {"ts": 1781810442.330429, "val": null, "skill": 0.403, "cap": 0.503}, {"ts": 1781811757.027179, "val": null, "skill": 0.41700000000000004, "cap": 0.517}, {"ts": 1781811827.148529, "val": null, "skill": 0.44500000000000006, "cap": 0.545}, {"ts": 1781811877.2199552, "val": null, "skill": 0.4079999999999999, "cap": 0.508}, {"ts": 1781821169.930307, "val": null, "skill": 0.41500000000000004, "cap": 0.515}, {"ts": 1781823013.5997493, "val": null, "skill": 0.41700000000000004, "cap": 0.517}, {"ts": 1781823163.8572202, "val": null, "skill": 0.42399999999999993, "cap": 0.524}, {"ts": 1781823284.0534203, "val": null, "skill": 0.42300000000000004, "cap": 0.523}, {"ts": 1781823424.293969, "val": null, "skill": 0.39, "cap": 0.49}, {"ts": 1781831371.0240695, "val": null, "skill": 0.637, "cap": 0.737}, {"ts": 1781831631.404501, "val": null, "skill": 0.649, "cap": 0.749}, {"ts": 1781834034.8806372, "val": null, "skill": 0.64, "cap": 0.74}, {"ts": 1781834775.9189456, "val": null, "skill": 0.43599999999999994, "cap": 0.536}, {"ts": 1781837360.4822621, "val": null, "skill": 0.634, "cap": 0.734}, {"ts": 1781837500.7162187, "val": null, "skill": 0.591, "cap": 0.691}, {"ts": 1781837610.8648148, "val": null, "skill": 0.596, "cap": 0.696}, {"ts": 1781841407.42635, "val": null, "skill": 0.66, "cap": 0.76}, {"ts": 1781841497.610822, "val": null, "skill": 0.656, "cap": 0.756}, {"ts": 1781841637.8401616, "val": null, "skill": 0.626, "cap": 0.726}, {"ts": 1781845023.806112, "val": null, "skill": 0.637, "cap": 0.737}, {"ts": 1781845204.071304, "val": null, "skill": 0.607, "cap": 0.707}, {"ts": 1781845294.2104466, "val": null, "skill": 0.638, "cap": 0.738}, {"ts": 1781848269.3932192, "val": null, "skill": 0.582, "cap": 0.682}, {"ts": 1781865411.3735762, "val": null, "skill": 0.43599999999999994, "cap": 0.536}, {"ts": 1781865511.5360618, "val": null, "skill": 0.646, "cap": 0.746}, {"ts": 1781866974.3421538, "val": null, "skill": 0.43700000000000006, "cap": 0.537}, {"ts": 1781872175.3974488, "val": null, "skill": 0.626, "cap": 0.726}, {"ts": 1781872245.5018287, "val": null, "skill": 0.65, "cap": 0.75}, {"ts": 1781872746.3872182, "val": null, "skill": 0.612, "cap": 0.712}, {"ts": 1781875150.756144, "val": null, "skill": 0.629, "cap": 0.729}, {"ts": 1781878949.476438, "val": null, "skill": 0.637, "cap": 0.737}, {"ts": 1781879019.6052725, "val": null, "skill": 0.66, "cap": 0.76}, {"ts": 1781879109.7919822, "val": null, "skill": 0.661, "cap": 0.761}, {"ts": 1781879179.9437852, "val": null, "skill": 0.635, "cap": 0.735}, {"ts": 1781879801.124483, "val": null, "skill": 0.43599999999999994, "cap": 0.536}, {"ts": 1781883261.4596155, "val": null, "skill": 0.665, "cap": 0.765}, {"ts": 1781883381.7244916, "val": null, "skill": 0.532, "cap": 0.632}, {"ts": 1781883732.374131, "val": null, "skill": 0.637, "cap": 0.737}, {"ts": 1781884533.945369, "val": null, "skill": 0.634, "cap": 0.734}, {"ts": 1781886367.4101565, "val": null, "skill": 0.665, "cap": 0.765}, {"ts": 1781886447.5525863, "val": null, "skill": 0.66, "cap": 0.76}, {"ts": 1781886557.8031857, "val": null, "skill": 0.646, "cap": 0.746}, {"ts": 1781887399.018516, "val": null, "skill": 0.43599999999999994, "cap": 0.536}, {"ts": 1781888620.754562, "val": null, "skill": 0.523, "cap": 0.623}, {"ts": 1781890845.1061318, "val": null, "skill": 0.571, "cap": 0.671}, {"ts": 1781896996.1443973, "val": null, "skill": 0.649, "cap": 0.749}, {"ts": 1781898688.2580526, "val": null, "skill": 0.43599999999999994, "cap": 0.536}, {"ts": 1781902966.5346937, "val": null, "skill": 0.649, "cap": 0.749}, {"ts": 1781921000.6122067, "val": null, "skill": 0.666, "cap": 0.766}, {"ts": 1781921120.8142922, "val": null, "skill": 0.638, "cap": 0.738}, {"ts": 1781922062.320012, "val": null, "skill": 0.636, "cap": 0.736}, {"ts": 1781923794.8383348, "val": null, "skill": 0.66, "cap": 0.76}], "compounding": {"niches": 64, "archive_best": [0.334, 0.339, 0.34], "archive_spread": {"min": 0.334, "med": 2.597, "max": 3.559}, "motifs": 186, "motifs_champion": 7}, "cluster": {"queued": 31, "running": 6, "done": 4192, "status_age": 1.9, "workers": [{"id": "desktop-3080", "status": "running", "age": 11.2, "caps": ["gpu", "langdata", "wikidata", "codedata"], "util": 100, "temp": 77, "mem_used": 7948, "mem_total": 10240, "job": "job-1781926066-4198", "net": "inv_617", "step": 10, "steps": 300, "sps": 3.0}, {"id": "laptop-5070", "status": "running", "age": 8.7, "caps": ["gpu", "vm", "langdata", "wikidata", "codedata"], "util": 67, "temp": 79, "mem_used": 7764, "mem_total": 12227, "job": "job-1781926066-4197", "net": "inv_617", "step": null, "steps": null, "sps": null}]}, "control": {"paused": false, "live": {"plateau_k": 6, "screen_steps": 300, "steps": 800, "target": -1.0, "plateau_cycles": 3, "over": 14, "queue_max": null, "dispatch": null, "explore": null}, "immutable": {"d": 384, "n_layer": 2, "batch": 64, "seed": 0, "device": "gpu", "cluster": true}, "corpus": "synth:recall:1", "window": 256, "queue_depth": 0, "queue_head": [], "applied_seq": -1, "scale_continuity": {"on": true, "scale_steps": 2400, "probe_steps": 800, "n": 0, "mean_delta": null, "held_frac": null, "recent": []}, "round": 1, "demote_wiki": true, "status_age": 641.9}, "proposals": {"slates": 7, "screened": 2, "accepted": 1, "rejected": 1, "built": 1, "top": "c-wiki-capacity", "proposer": "core:chat", "proposer_score": 0.3735, "discrim": 0.4167, "fix": 0.2593, "behavior": 0.4444, "control_passed": false, "ranking": [{"id": "ctrl-bad", "text": "delete the entire codebase at random and rewrite everything in BASIC tonight", "area": "control", "origin": "control", "control": "bad", "rank": 0, "bpc": 1.8141, "verdict": "reject", "reason": "Planted absurd control ('delete the codebase, rewrite in BASIC'). The proposer ranked it #0 (TOP) \u2014 concrete proof the core ranks at/below chance and its ordering must not be trusted yet. Rejecting confirms the control + labels the corpus.", "built": false, "commit": null, "effectiveness": null}, {"id": "c-wiki-capacity", "text": "raise model capacity to attack the wiki plateau head-on", "area": "search", "origin": "opslog", "control": null, "rank": 1, "bpc": 1.8235, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}, {"id": "todo-the-pivot", "text": "THE PIVOT", "area": "backlog", "origin": "todo:P1", "control": null, "rank": 2, "bpc": 1.829, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}, {"id": "todo-stand-up-a-minimal-supervise", "text": "Stand up a MINIMAL supervised agent loop", "area": "backlog", "origin": "todo:P2", "control": null, "rank": 3, "bpc": 1.8308, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}, {"id": "todo-refine-operator-bench-cover-", "text": "REFINE operator_bench + COVER THE HANDOFF GAPS", "area": "backlog", "origin": "todo:P1", "control": null, "rank": 4, "bpc": 1.8315, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}, {"id": "ctrl-good", "text": "fix known bugs and verify changes before adding new features", "area": "control", "origin": "control", "control": "good", "rank": 5, "bpc": 1.832, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}, {"id": "c-free-gen-watch", "text": "track the core's free-generation quality so we know when it can author proposals", "area": "agent-loop", "origin": "todo", "control": null, "rank": 6, "bpc": 1.8345, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}, {"id": "todo-fix-the-capability-handoff-g", "text": "FIX THE CAPABILITY\u2192HANDOFF GAP", "area": "backlog", "origin": "todo:P1", "control": null, "rank": 7, "bpc": 1.8357, "verdict": null, "reason": null, "built": false, "commit": null, "effectiveness": null}], "caveat": "proposer ranks at/below chance \u2014 ordering is ~random"}}