AI model
Meta's open-weight 70-billion-parameter large language model, instruction-tuned for chat and reasoning tasks within the Llama 3 family.
Serving a 70B model takes about 141 GB of GPU memory for weights at 16-bit, 73 GB at FP8 and 40 GB at 4-bit, according to a dev.to post. Fine-tuning takes about 50 GB with QLoRA and 1.1 TB with full AdamW. The post maps both onto GPU setups and hourly rental prices.
Reality
Three consortia will run a free tier with no usage caps on state-supplied hardware, under a rule that Korean models carry at least half the load. The ministry has published neither the cost nor a target for uptake.
Perspective Coverage
5 publishersReality
A September 3 playbook traces speculative decoding's draft architectures from EAGLE-3 to DFlash, and grounds the case in a 70B model that decodes at 15 to 20 tokens a second on eight H100s.
Reality
Bedrock bills for Llama 3.3 70B customisation while publishing no price for it, and the number circulating in third-party guides is a Llama 2 70B rate. A 33-region API sweep found one region that can run the job.
Reality
A dev.to harness put five coding tasks through four APIs and every run passed its verifier on the first attempt, so the only thing left to compare is clock time, where one trial per cell sets a fragile order.
Reality
The bandwidth gap is 4.4x and the capacity gap is 4x, which is why these two boxes are not really competing. One decides whether a model fits; the other decides whether it is usable.
Reality
Self-propagating payloads did move between agents through editable soul files, but one inoculation paragraph held against 150-plus optimized strains, and nothing propagated in the wild.
Reality