TokenPost·
SK hynix Proposes Shared Memory Racks for AI Inference Systems
An internal test using remote CXL DRAM cut average time to first token to 15.45 seconds from 80.76 seconds, an approximately 81% reduction. SK hynix said validation with Intel and partners will start in the system-des…