Analogy: keeping past plot notes open instead of rereading the entire manuscript per new word.
Watch VRAM scale linearly with sequence length.
#AI #SystemDesign #DistributedSystems
Analogy: keeping past plot notes open instead of rereading the entire manuscript per new word.
Watch VRAM scale linearly with sequence length.
#AI #SystemDesign #DistributedSystems
Trade-off: O(1) compute per step vs O(N) linear VRAM scaling. Essential for latency.
#SystemDesign #AI #SoftwareEngineering
Trade-off: O(1) compute per step vs O(N) linear VRAM scaling. Essential for latency.
#SystemDesign #AI #SoftwareEngineering
I considered recomputing the path at the edge of the viewport, adding a random pause, adjusting fish tints, adding a glide animation, but it's fine for now :)
I considered recomputing the path at the edge of the viewport, adding a random pause, adjusting fish tints, adding a glide animation, but it's fine for now :)
The architectural insight:
Refresh predictions when data changes, rather than recomputing them on every request.
www.infoq.com/news/2026/10...
#DataEngineering
The architectural insight:
Refresh predictions when data changes, rather than recomputing them on every request.
www.infoq.com/news/2026/10...
#DataEngineering
huggingface.co/datasets/Loc...
huggingface.co/datasets/Loc...
Like keeping intermediate math steps on a scratchpad. O(N²) to O(1) step latency.
#SystemDesign #AI
Like keeping intermediate math steps on a scratchpad. O(N²) to O(1) step latency.
#SystemDesign #AI
Reconcile Bitcoin settlements without expensive chain scans: design a settlement-proof receipt.
• On settlement, return {tx_hash, settle_ts, receipt_sig = HMAC(tx_hash|merchant_id|secret)}
• Store only receipt_sig + tx_hash index; let support verify proof by recomputing HMAC
Reconcile Bitcoin settlements without expensive chain scans: design a settlement-proof receipt.
• On settlement, return {tx_hash, settle_ts, receipt_sig = HMAC(tx_hash|merchant_id|secret)}
• Store only receipt_sig + tx_hash index; let support verify proof by recomputing HMAC
Then maybe we should base property taxes on Homesteads, if we have property taxes on Homesteads at all, on an inflation adjusted basis of your purchase price with no appreciation. Market value is all theoretical anyway.