Winning Health Technology Group is accelerating the use of Large Language Models (LLMs) in healthcare with its WiNGPT platform, optimized through collaboration with Intel. By leveraging graph optimization and weight-only quantization on 5th Gen Intel® Xeon® Scalable processors with Intel® Advanced Matrix Extensions, WiNGPT delivers enhanced LLM performance, cost-effectiveness, and application efficiency. Using CPUs for inference allows healthcare institutions to flexibly allocate computing resources across different IT needs, improving agility and enabling smarter deployment of AI-driven services in traditional medical scenarios.

Join for free to read