Luke Davies-Cooke •September 2, 2022
The 7 Features You Need to Look For When Choosing a DICOM Annotation Tool
If you’re trying to create training data for a medical AI model, you might have used free and open-source tools like ITK SNAP to label medical images. And they’re great as a starting point, but do lack a number of features for annotating efficiently and effectively.
So if you’ve come to the conclusion that you need a better solution for labelling medical images (especially in DICOM or NIfTI formats), you’ll be looking around at image labelling tools. But even when looking at paid for tools, there is an element of risk. Not all image annotation tools are created equal, especially when it comes to the specific needs of the computer vision and healthcare space.
So to help you find the right platform, we’ve created a guide to the seven features you need to look for when choosing tools for annotating and labelling DICOM images.
Native DICOM support
It might seem obvious, but a fundamental consideration is whether the annotation tool you’re looking at can support DICOM files natively (it also helps if it can natively support other file formats, like NIfTI). What that means is whether the tool can open and view DICOM files without having to convert them to some other format (such as a video file).
When a file is converted from DICOM to something else, it increases the chances of data being lost (such as DICOM metadata) or the converted file being corrupted in some way. Converted files are also not displayed using Hounsfield units, because they have to be shifted to a grayscale range that is compatible with the file format they've been converted to. Ultimately this results in lower quality annotations as your annotators are losing vital data from the images they’re looking at. And given the importance of having high quality training data for medical AI models, it makes sense to ensure you’re not losing anything when you add your image files into your data labeling tool.
DICOM support in Encord
Native 3D annotation
Another key feature is the ability to view and annotate images in 3D, natively within the annotation platform. This makes it easier to identify objects within the scans (such as cancerous tumours) and also allows for volumetric annotations, where you’re labeling something in three dimensions. Having the ability to annotate radiology images in 3D means you can create better annotations and ultimately create better data to train your model on
Easy to use interface
While this might seem like a basic point, it is something that needs a lot of consideration. There are many labeling tools out there that can be used to annotate medical images, but they won’t have been designed with this specific task in mind. Annotating a chest X-Ray or brain MRI is a very different task to labelling road signs or fruit, and the tool you use has to reflect that.
Some key usability features you need to look for when choosing a DICOM annotation tool include:
- The ability to render images in the full range of the Hounsfield scale
- Multiplanar reconstruction showing images in 2D orthogonal planes (coronal, sagittal, axial) so you can better visualize, analyze, and annotate the images
- Window width (WW) and window level (WL) adjustments with the option to save custom presets, which can save your annotators time
- A distance measurement tool for measuring accurate, real-world distance between any two points in an image
- View metadata as an overlay so your annotators can easily see the metadata when they need it.
Window width and window level adjustment in Encord
Automated annotation of DICOM images
Given the expense of using highly skilled medical annotators, any feature that can make them more efficient is vital. This is why your DICOM annotation tool needs to have annotation automation functionality. There are a number of ways automation can be achieved, but one of the most powerful is interpolation. But not all interpolation features are the same. You’ll want one that:
- Doesn’t need matching pixel information in neighbouring frames in order to function
- Doesn’t require a matching number of vertices between objects in set keyframes
- Allows you to draw object vertices in arbitrary directions, and not have to follow a predefined direction
Quality control features
Maintaining the quality of your labelled data vital for ensuring your models have the best ground truth to learn from. And being able to put rigorous quality control measures in place can make this much easier and efficient. What you need to be looking for in your DICOM annotation platform is two things. The first is the ability to set granular parameters for your quality control workflows. This should include:
- The percentage of labels that are to be manually reviewed
- Rules for distribution of review tasks
- Common rejection reasons that can be used to identify and systematize errors in your labels
- Reviewer to class and annotator mapping (e.g. label X with class Y should always be reviewed by reviewer Z)
- Assign tasks that are rejected after a specific number of review cycles for expert reviews.
Then the second quality control feature to look for is being able to dynamically change the sampling rate applied to submitted annotation tasks. This means the project administrator can set a higher proportion of submitted labels the reviewer should look at, increasing overall quality of the labeled data. It also helps if this can be tweaked further to set sampling rates by annotator and annotation type, so that more complex images get a more thorough review.
Data labeling quality control panel in Encord
The penultimate feature you need to consider for your DICOM annotation tool is around creating an audit trail. To get FDA or CE approval, one of the requirements is being able to provide a full audit trail of the data that your medical diagnostic model is trained on. With this in mind, your labeling tool needs to have the ability to show a full audit trail for every label produced and the review process behind that label.
SOC2 and HIPAA compliance
And finally, whatever medical image labelling tool you end up using, if you’re going to be using it to handle sensitive patient data, it needs to comply with a couple of key frameworks.
The first of these is SOC 2 (Systems and Organizational Control 2), which demonstrates that an organization’s business process, information technology and risk management controls are properly designed. The second of these is compliance with HIPAA (Health Insurance Portability and Accountability Act), showing that the data labeling platform looks after patient data in accordance with the rules of HIPAA.
So there you have it - seven features that you should be looking at when choosing your DICOM annotation platform. Taken together, these features can make your medical image labeling much more efficient while also resulting in better labeled data and reduced risk.
If you are in the market for a DICOM annotation tool (which also supports NIfTI and a range of other file formats), why not arrange a call with us to get a demo of Encord.
Luke is the head of marketing at Encord. He has extensive experience helping B2B software companies better communicate with their audiences and grow their revenue. He holds a degree in Law and French from the University of Reading. https://www.linkedin.com/in/lukedaviescooke/
November 28, 2022
6 min read
November 28, 2022
12 min read
November 24, 2022