Jump to content

Studierfenster

Add links
From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by 132.170.199.112 (talk) at 18:49, 23 March 2022 (→Architecture). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

StudierFenster
Developer(s)University Hospital Essen, Graz University of Technology, Medical University of Graz
Initial release2018; 6 years ago (2018)
Written inC, C++, Python, JavaScript, HTML
Operating systemCross-platform
(Windows, Mac OS X, Linux)
Available inEnglish
TypeImage processing, scientific visualization, medical imaging, volume rendering, Interactive visualization
LicenseGPL, CC-BY-SA
Websitestudierfenster.tugraz.at
Brain Tumor Segmentation under Studierfenster.
Aortic Dissection Inpainting under Studierfenster.

Studierfenster[1][2][3] is a free, non-commercial open science client/server-based medical imaging processing online framework. It offers capabilities, like viewing medical data (computed tomography, magnetic resonance imaging, etc.) in two- and three-dimensional space directly in standard web browsers, like Google Chrome, Mozilla Firefox, Safari, and Microsoft Edge. Other functionalities are the calculation of medical metrics (dice score[4] and Hausdorff distance[5]), manual slice-by-slice outlining of structures in medical images (segmentation[6][7]), manual placing of (anatomical) landmarks in medical image data, viewing medical data in virtual reality and a facial reconstruction and registration of medical data for augmented reality.[8]

Other features of Studierfenster are the automatic cranial implant design with a neural network,[9][10] the inpainting of aortic dissections[11] with a generative adversarial network[12][13] and an automatic aortic landmark detection with deep learning[14] in computed tomography angiography scans.

Studierfenster is currently hosted on an server at the Graz University of Technology[15] in Austria, and expanded jointly with the Institute for Artificial Intelligence in Medicine (IKIM)[16] in Essen, Germany.

History

Studierfenster was initiated within two bachelor theses during the summer bachelor program of the Institute of Computer Graphics and Vision at Graz University of Technology, Austria, in cooperation with the Medical University of Graz, Austria, in 2018/2019.[17][18]

The name Studierfenster (or StudierFenster) is German and can be translated to 'StudyWindow', whereby window refers here to a browser window. The word Studierfenster is an adaption from the word Studierstube ('study room'), which was an augmented reality project at the Vienna University of Technology in Austria.[19][20]

Architecture

The Studierfenster Architecture.

Studierfenster is setup as a distributed application via a client–server model. The client side (front-end) consists of HTML and JavaScript. The front-end also uses the web graphics library (WebGL) that is a Javascript application programming interface descending from the Open Graphics Library ES 2.0 specification, which it still closely resembles. In contrast to OpenGL, WebGL allows for the rendering of two- and three-dimensional graphics in web browsers. This enables the use of graphics features known from stand-alone programs directly in web applications, supported by the processing power of the client-side graphics processing unit.

The server side (back-end) handles client requests via C, C++ and Python.[21] It interfaces to common open source libraries and software tools like the Insight Toolkit,[22] the Visualization Toolkit (VTK),[23] the X Toolkit (XTK)[24] and Slice:Drop.[25] The server communication is handled by AJAX requests[26] were needed.

Studierfenster employs a Flask server.

Features

Dicom browser

The Studierfenster DICOM Browser

This allows client-side parsing a local folder with DICOM (Digital Imaging and Communications in Medicine)[27][28] files. Afterwards, the whole folder can be converted to compressed .nrrd (nearly raw raster data) files and downloaded as a single .zip file.

Nrrd is a library and file format for the representation and processing of n-dimensional raster data. It is intended to support scientific visualization and (medical) image processing applications.[29] With the "Dicom Browser" of Studierfenster, it is possible to select specific Studies or Series, and only convert these.

File converter

The file converter converts a medical volume file (e.g. a non-compressed .nrrd file) to a compressed/binary .nrrd file. After the conversion, the compressed .nrrd file can be downloaded and used with the "Medical 3D Viewer" for 2D and 3D visualization, and further image processing.

Metrics module

The Studierfenster Metrics Module

This can calculate the Dice similarity coefficient and Hausdorff distance between two segmentation masks (in .nrrd format) in a standard web browser.

The resulting table has seven columns: the file names for both files used in the calculation, the calculated Dice similarity coefficient, the calculated Hausdorff distance, the calculated directed HD for both directions and the information if image spacing was used in the calculation. The table can be sorted, is searchable and can be exported as a simple copy, an Excel spreadsheet, a comma-separated values file or as a portable document format.

The Metrics Module has been used to compare manual anatomical segmentations of brain tumors[30]

VR viewer

Virtual Reality under Studierfenster.

The VR Viewer (or Medical VR Viewer) enables viewing (medical) data in Virtual Reality (VR) with devices like the Google Cardboard or the HTC Vive (via the WebVR App).[31] For viewing the data in VR, it needs to be converted to the VTI (.vti) format, which can be done with open-source, multi-platform data analysis and visualization application ParaView[32]

Critics

Studierfenster is not a certified medical product; it can only be used for educational, research, and informational purposes.

References

  1. ^ "Studierfenster". Retrieved April 23, 2020.
  2. ^ Egger, Jan; Wild, Daniel; Weber, Maximilian; Ramirez Bedoya, Christopher; Karner, Florian; Prutsch, Alexander; Schmied, Michael; Dionysio, Christina; Krobath, Dominik; Jin, Yuan; Gsaxner, Christina; Li, Jianning; Pepe, Antonio (2022). "Studierfenster: an Open Science Cloud-Based Medical Imaging Analysis Platform". Journal of Digital Imaging. Cham: Springer International Publishing: 1–16. doi:10.1007/s10278-021-00574-8. PMC 8782222. PMID 35064372.
  3. ^ Weber, Maximilian (October 17, 2019). "A Client/Server-based Online Environment for the Calculation of Medical Segmentation Scores". 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Vol. 2019. pp. 3463–3467. doi:10.1109/EMBC.2019.8856481. ISBN 978-1-5386-1311-5. PMID 31946624. S2CID 199373900. {{cite book}}: |journal= ignored (help)
  4. ^ Dice, Lee R. (1945). "Measures of the Amount of Ecologic Association Between Species". Ecology. 26 (3): 297–302. doi:10.2307/1932409. JSTOR 1932409.
  5. ^ Rockafellar, R. Tyrrell; Wets, Roger J-B (2005). Variational Analysis. Springer-Verlag. p. 117. ISBN 3-540-62772-3.
  6. ^ Linda G. Shapiro and George C. Stockman (2001): “Computer Vision”, pp 279–325, New Jersey, Prentice-Hall, ISBN 0-13-030796-3
  7. ^ Barghout, Lauren, and Lawrence W. Lee. "Perceptual information processing system." Paravue Inc. U.S. Patent Application 10/618,543, filed July 11, 2003.
  8. ^ Gsaxner, Christina; Pepe, Antonio; Wallner, Jürgen; Schmalstieg, Dieter; Egger, Jan (2019). Shen, Dinggang; Liu, Tianming; Peters, Terry M.; Staib, Lawrence H.; Essert, Caroline; Zhou, Sean; Yap, Pew-Thian; Khan, Ali (eds.). "Markerless Image-to-Face Registration for Untethered Augmented Reality in Head and Neck Surgery". Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. Lecture Notes in Computer Science. 11768. Cham: Springer International Publishing: 236–244. doi:10.1007/978-3-030-32254-0_27. ISBN 978-3-030-32254-0. S2CID 202620139.
  9. ^ Li, Jianning (January 2020). "Deep Learning for Cranial Defect Reconstruction". Master Thesis, Institute of Computer Graphics and Vision, Graz University of Technology, Austria, pp. 1-68, January 2020.
  10. ^ Li, Jianning; Pepe, Antonio; Gsaxner, Christina; Egger, Jan (2020). "An Online Platform for Automatic Skull Defect Restoration and Cranial Implant Design". arXiv:2006.00980 [physics.med-ph].
  11. ^ Pepe, Antonio; Li, Jianning; Rolf-Pissarczyk, Malte; Gsaxner, Christina; Chen, Xiaojun; Holzapfel, Gerhard A.; Egger, Jan (2020). "Detection, Segmentation, Simulation and Visualization of Aortic Dissections: A Review". Medical Image Analysis. 65: 101773. doi:10.1016/j.media.2020.101773. PMID 32738647. S2CID 220924735.
  12. ^ Prutsch, Alexander. "Design and Development of a Web-based Tool for Inpainting ofDissected Aortae in Angiography Images" (PDF). Retrieved April 25, 2020.
  13. ^ Goodfellow, Ian; Pouget-Abadie, Jean; Mirza, Mehdi; Xu, Bing; Warde-Farley, David; Ozair, Sherjil; Courville, Aaron; Bengio, Yoshua (2014). Generative Adversarial Networks (PDF). Proceedings of the International Conference on Neural Information Processing Systems (NIPS 2014). pp. 2672–2680.
  14. ^ Schmidhuber, J. (2015). "Deep Learning in Neural Networks: An Overview". Neural Networks. 61: 85–117. arXiv:1404.7828. doi:10.1016/j.neunet.2014.09.003. PMID 25462637. S2CID 11715509.
  15. ^ "Graz University of Technology". Retrieved April 28, 2020.
  16. ^ "Artificial Intelligence in Medicine". Retrieved February 9, 2022.
  17. ^ Weber, Maximilian (December 13, 2018). A Client/Server based Online Environment for the calculation of Segmentation Scores (Bachelor Thesis). Austria: Institute of Computer Graphics and Vision, Graz University of Technology. pp. 1–40.
  18. ^ Wild, Daniel; Weber, Maximilian; Egger, Jan (2019). "Client/Server Based Online Environment for Manual Segmentation of Medical Images". arXiv:1904.08610 [cs.CV].
  19. ^ "Studierstube" (PDF). Retrieved April 26, 2020.
  20. ^ Szalavári, Zsolt; Schmalstieg, Dieter; Fuhrmann, Anton; Gervautz, Michael (1998). "Studierstube: An environment for collaboration in augmented reality". Virtual Reality. Lecture Notes in Computer Science. 3. Springer International Publishing: 37–48. doi:10.1007/BF01409796. S2CID 1122975.
  21. ^ "Python". Retrieved April 29, 2020.
  22. ^ "The Insight Toolkit". Retrieved April 27, 2020.
  23. ^ "VTK - The Visualization Toolkit". Retrieved April 27, 2020.
  24. ^ "The X Toolkit: WebGL™ for Scientific Visualization". GitHub. April 25, 2020. Retrieved April 27, 2020.
  25. ^ "Slice:Drop". Retrieved April 27, 2020.
  26. ^ "Ajax - Web developer guides". MDN Web Docs. Archived from the original on February 28, 2018. Retrieved February 27, 2018.
  27. ^ "1 Scope and Field of Application". dicom.nema.org.
  28. ^ DICOM brochure, nema.org.
  29. ^ Aja-Fernández, Santiago; de Luis Garcia, Rodrigo; Tao, Dacheng; Li, Xuelong (2009). Tensors in Image Processing and Computer Vision. Advances in Computer Vision and Pattern Recognition. Springer Science & Business Media. ISBN 9781848822993.
  30. ^ Bhandari, Abhishta; Koppen, Jarrad; Agzarian, Marc (2020). "Convolutional neural networks for brain tumour segmentation". Insights into Imaging. Lecture Notes in Computer Science. 11:77 (1). Springer Open: 77. doi:10.1186/s13244-020-00869-4. PMC 7280397. PMID 32514649.{{cite journal}}: CS1 maint: unflagged free DOI (link)
  31. ^ Egger, Jan (March 12, 2017). "HTC Vive MeVisLab integration via OpenVR for medical applications". PLOS ONE. 12 (3): e0173972. arXiv:1703.07575. Bibcode:2017PLoSO..1273972E. doi:10.1371/journal.pone.0173972. PMC 5360258. PMID 28323840.
  32. ^ "ParaView". Retrieved May 24, 2020.
Retrieved from "https://en.wikipedia.org/enwiki/w/index.php?title=Studierfenster&oldid=1078862350"