Winning Health’s WiNGPT, a large language model tailored for healthcare, enhances smart hospital services like diagnostics and report generation. Partnering with Intel, they optimized WiNGPT using 5th Gen Intel® Xeon® Scalable processors with built-in AI acceleration (Intel® AMX), achieving over 3x faster inference than previous generations. This CPU-based solution offers hospitals a cost-effective, scalable, and private deployment model, avoiding GPU reliance while supporting flexible workloads. Further optimizations in memory access and algorithm efficiency ensure faster, accurate results, enabling broader LLM adoption in medical scenarios with lower total cost of ownership.

Join for free to read