|
| 1 | +--- |
| 2 | +layout: default |
| 3 | +title: MIST |
| 4 | +--- |
| 5 | + |
| 6 | +<section class="hero"> |
| 7 | + <h1>MIST: Medical Image Streaming Toolkit</h1> |
| 8 | + <p class="subtitle">A unified framework for intelligent, progressive, and resource-efficient medical image streaming.</p> |
| 9 | + <div class="btn-container"> |
| 10 | + <a href="https://doi.org/10.1007/s10278-024-01173-z" class="btn">Journal Paper (JIIM 2024)</a> |
| 11 | + <a href="https://openreview.net/forum?id=IIuULGCHLY¬eId=IIuULGCHLY" class="btn">Conference Paper (MIDL 2025)</a> |
| 12 | + <a href="https://patentscope.wipo.int/search/en/detail.jsf?docId=WO2024233969" class="btn">Patent</a> |
| 13 | + <a href="https://github.com/BioIntelligence-Lab/MIST" class="btn">GitHub</a> |
| 14 | + </div> |
| 15 | +</section> |
| 16 | + |
| 17 | +<section id="architecture"> |
| 18 | + <h2>Architecture</h2> |
| 19 | + <p class="center">A schematic representation of MIST's hierarchical and adaptive streaming pipeline.</p> |
| 20 | + <img src="https://raw.githubusercontent.com/BioIntelligence-Lab/MIST/main/assets/overview.png" alt="MIST Architecture Overview" class="diagram"> |
| 21 | + </section> |
| 22 | + |
| 23 | + <section id="overview"> |
| 24 | +<p><strong>MIST</strong> and <strong>ISLE</strong> represent two complementary frameworks addressing the challenges of large-scale medical imaging datasets and AI-driven inference systems.</p> |
| 25 | +<h2>Overview</h2> |
| 26 | +<h3>MIST: Medical Imaging Streaming Toolkit</h3> |
| 27 | +<ul class="highlights"> |
| 28 | +<li><strong>Challenge:</strong> Large-scale imaging datasets require significant storage and bandwidth, limiting accessibility for AI research and clinical deployment.</li> |
| 29 | +<li><strong>MIST Solution:</strong> A format-agnostic database enabling streaming of medical images at multiple resolutions and formats from a single high-resolution copy.</li> |
| 30 | +<li><strong>Evaluation:</strong> Tested across eight diverse datasets (CT, MRI, X-ray) covering multiple modalities and file formats.</li> |
| 31 | +<li><strong>Results:</strong> Reduced storage and bandwidth requirements without impacting image quality or downstream deep learning performance.</li> |
| 32 | +<li><strong>Impact:</strong> Creates a data-efficient, format-agnostic platform that reduces barriers to AI research in medical imaging.</li> |
| 33 | +</ul> |
| 34 | + |
| 35 | + |
| 36 | +<h3>ISLE: Intelligent Streaming for AI Inference</h3> |
| 37 | +<ul class="highlights"> |
| 38 | +<li><strong>Motivation:</strong> Growing adoption of AI systems in radiology is increasing demands for bandwidth and computational resources.</li> |
| 39 | +<li><strong>ISLE Framework:</strong> An intelligent streaming method inspired by video-on-demand platforms to deliver only the resolution needed for AI inference using progressive encoding.</li> |
| 40 | +<li><strong>Results (Classification):</strong> Reduced transmission by ≥90% and decoding time by ≥87%</li> |
| 41 | +<li><strong>Results (Segmentation):</strong> Reduced transmission by ≥77% and decoding time by ≥89%</li> |
| 42 | +<li><strong>Performance:</strong> No impact on diagnostic performance (all P > 0.05).</li> |
| 43 | +<li><strong>Impact:</strong> Improves data and computational efficiency for AI deployment in clinical environments without compromising diagnostic accuracy.</li> |
| 44 | +</ul> |
| 45 | +</section> |
| 46 | + |
| 47 | + <section id="opensource"> |
| 48 | + <h2>Open-Source Tools</h2> |
| 49 | + <table> |
| 50 | + <tr><th>Component</th><th>Description</th><th>Repository</th></tr> |
| 51 | + <tr><td>MIST</td><td>Core streaming and dataset management framework</td><td><a href="https://github.com/BioIntelligence-Lab/MIST">GitHub</a></td></tr> |
| 52 | + <tr><td>IntelligentStreaming</td><td>AI-aware streaming for real-time inference</td><td><a href="https://github.com/BioIntelligence-Lab/IntelligentStreaming">GitHub</a></td></tr> |
| 53 | + <tr><td>OpenJPHpy</td><td>Python interface for HTJ2K codec</td><td><a href="https://github.com/BioIntelligence-Lab/openjphpy">GitHub</a></td></tr> |
| 54 | + </table> |
| 55 | + </section> |
| 56 | + |
| 57 | + <section id="patent"> |
| 58 | + <h2>Patents</h2> |
| 59 | + <p><strong>Patent:</strong> <a href="https://patents.google.com/patent/WO2024233969A1/en?oq=WO2024233969A1">WO2024233969A1</a> — <em>Systems and methods for high-throughput analysis for graphical data</em></p> |
| 60 | + <p><strong>Filed by:</strong> University of Maryland Baltimore <br> |
| 61 | + <strong>Inventors:</strong> Vishwa S. Parekh, Pranav Kulkarni, Adway Kanhere, Paul H. Yi, Eliot L. Siegel</p> |
| 62 | + </section> |
| 63 | + |
| 64 | + <section id="publications"> |
| 65 | + <h2>Publications</h2> |
| 66 | + <p>Kulkarni P., Kanhere A., Siegel E.L., Yi P.H., Parekh V.S. <em>ISLE: An Intelligent Streaming Framework for High-Throughput AI Inference in Medical Imaging.</em> <strong>Journal of Imaging Informatics in Medicine. 2024 Dec;37(6):3250-63. <a href="https://doi.org/10.1007/s10278-024-01173-z">DOI</a></p> |
| 67 | + <p>Kulkarni P., Kanhere A., Siegel E., Yi P., Parekh V.S. <em>Towards Resource-Efficient Streaming of Large-Scale Medical Image Datasets for Deep Learning.</em> <strong>Medical Imaging with Deep Learning (MIDL)</strong> (2025). <a href="https://openreview.net/forum?id=IIuULGCHLY¬eId=IIuULGCHLY">OpenReview</a></p> |
| 68 | + </section> |
| 69 | + |
| 70 | + <section id="contact"> |
| 71 | + <h2>Contact</h2> |
| 72 | + <p class="center"><strong>Dr. Vishwa S. Parekh</strong><br> |
| 73 | + UTHealth Houston<br> |
| 74 | + <a href="mailto:vishwa.s.parekh@uth.tmc.edu">vishwa.s.parekh@uth.tmc.edu</a></p> |
| 75 | + </section> |
0 commit comments