Available Digital Tools
A range of tools are available to government agencies to support analysis of submissions. This page sets out which tools are available, who is using them and what functions they have.
In this page:
- The Analysis Tool Matrix
- Instructions to keep this resource current
- Centres of Expertise
- References, guides and key readings
The Analysis Tool Matrix
This is a list of digital tools used to analyse qualitative data by policy practitioners in the New Zealand government. The matrix helps compare the tools so that policy practitioners can determine which is best suited for the particular context.
We hope to support agencies to collaborate in choosing the best tools for the job and getting good value out of them.
The Analysis Tool Matrix is a non-exhaustive list of tools that could be used by policy teams within government to process submissions on policy. It includes a description of the tool, the ideal circumstances for use, and its limitations.
If you have an update for this list, please feel free to create a Pull Request on GitHub or email us at serviceinnovationlab@dia.govt.nz
Matrix
| Name | What it is | Why you should use it | Ideal circumstances for use | Limitations | Where is it used | Te Reo compatibility concerns | Cloud/Local | Cost | Theming | Sentiment | Input format | Output format | Features | Link for further info |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MAXQDA | Software package for qualitative and mixed methods research | - Doesn't cope well with >2000 documents - Projects cannot be accessed simultaneously by multiple users. Rather team members must have access to the program, work separately, and then merge files together. | DoC | N/A | Local | Standard $959 Plus $1139 Analytics Pro $1373 | Yes | No | Audio Video Text | Search queries, Word, Excel, HTML, Image files Visual Tools: maps. matrix. codeline, code relations browser, word cloud, graphs, comparison chart, customisable colours, Mixed methods features: Stats and graphs, cross tabs, similarity analysis, quote matrix. | https://www.maxqda.com/what-is-maxqda | |||
| NVivo | Software for gaining insights from qualitative and mixed-methods data | Industry standard, lots of people in government use it | - Difficult to extract data - Importing large datasets can take a large amount of time or may result in an error message - NVivo Mac has limited functionality (e.g. undo option not available for all actions) - Files from other programs, such as OneNote, not always imported accurately (i.e. missing data, change in layout). | MoE, MfE | N/A | Local | $1119 USD | Yes | No | text, audio, video, emails, images, spreadsheets, online surveys, social and web content and more | wordcloud, word trees, mindmap for nodes, heading formatting. | https://www.qsrinternational.com/nvivo/what-is-nvivo | ||
| Atlas.ti | Software for the qualitative analysis of large bodies of textual, graphical, audio and video data. | Qualitative data analysis tool that helps analyze documents, websites, and social media data. | Capturing perspectives & insights into primary or secondary research. | - Managing the project requires care because of the external database system - changes need to be carefully saved. - Main working code list does not have a functioning hierarchical structure. - Query tool lacks the ability to integrate searchers for text with searches for coded data. | N/A | Cloud/Local | Free Trial Version & Paid Licences | No | Yes | .txt; .doc; .docx; .odt; .pdf; .wav; .mp3; .wma; etc or even data from Evernote, Twitter, import entire surveys, etc. | - Offers an analytic level below coding - Supports inductive, interpretive research approaches like grounded theory, hermeneutic, discourse analysis, sociology of knowledge, or phenomenology - Network/visualization function - Offers an integrated way of working with your data - Produces visualization for analysis, for data organization as well as conceptual level analytic work and data presentation. - Able to create tags separate from codes | https://atlasti.com/product/what-is-atlas-ti/ | ||
| Dedoose | Software designed to support researchers, evaluators, and their teams looking to incorporated qualitative and mixed methods approaches in their working with text, audio, video, images, and survey and test data. | Allows collaboration | - Need Internet to use - Data security concerns with web-based features - Potential to lose data with web-based feature; however, nightly backups of data and data encryption for privacy and security are available | N/A | Cloud | Individual - $14.95USD/Per Active Month Small Group (2-5 users) - $12.95USD/Per Active User Per Month Student (with valid student ID) - $10.95USD/Per Active Month Large Group (6+ users) - $10.95USD/Per User Per Month First 30 Days FREE | Yes | Yes | rtf, txt, doc, docx, xlm, xls, xlsx, htm, html, mp3, wav, m4a, wma, mp4 | Data analysis and visualizations are exported to CSV files | - Web-based - Supports wide range of files - Teamwork is in real time and users can be assigned roles within Dedoose to control the flow of data - Interactive visualization and analytics - Calculates interrater reliability | https://www.dedoose.com | ||
| Thematic | Finds themes in feedback data, highlights their impact on key metrics, and visualizes insights in dashboards and reports. | Made mainly for customer feedback | N/A | Cloud | ? Contact for demo/pricing | Yes | No | Thematic API, SFTP, InMoment, AskNicely, SurveyMonkey, SurveyGizmo, Medallia, Salesforce and many other ways | Powerpoint slides, personalised dashboards and reports | - Finds actionable themes in raw data & turns it into a recommendations engine (ie. Thematic analysis) - Sentiment analysis - Analytical tools that compare themes - Themes Editor to suit unique needs - Translation of feedback into English prior to the analysis | https://getthematic.com/ | |||
| MonkeyLearn | Train custom machine learning models to get topic, sentiment, intent, keywords and more. | N/A | Cloud | Free - 300 Querries/mth; Low API Speed; 1 Small Custom Model Team (Free) - 10000 Querries/mth; Medium API Speed; 3 Small Custom Models Business (Schedule a Demo) - On Demand pricing. | No | Yes | CSV/Excel Files OR via direct integrations, Zapier or API. Text format such as: Emails; Support Tickets; Reviews; NPS Feedback; Surveys; Social Media. | Zapier connector, APIs, SDKs | - Build text classifiers for detecting topic, sentiment, intent, urgency and more - Build text extractors to identify specific data within text, including keywords, entities, features, and more. | https://monkeylearn.com/ | ||||
| QDA Miner | Free and easy-to-use version computer assisted qualitative analysis software. It offers basic CAQDAS features. | It can be used for the analysis of textual data such as interview and news transcripts, open-ended responses, etc. as well as for the analysis of still images. | - Lack of training resources - May not be as quick in product development as other QDA products | N/A | Local | Free (for Lite version) | Yes | No | doc, docx, pdf, rtf, txt, html, csv, xls, xlsx, mdb, xml, sav, dbf, asci | Export codebooks, reports,and visualizations using CSV or XML options. Export graphs to BMP, PNG, JPEG, WMF formats. | - Supports wide variety of a/v and text formats - Supports mixed methods data analysis - Has online automated training tutorials - Importation of documents from plain text, RTF, HTML, PDF as well as data stored in Excel, MS Access, CSV, tab delimited text files. - Importation from other qualitative coding software such as Atlas.ti. - Intuitive coding using codes organised in a tree structure. - Ability to add comments (or memos) to coded segments, cases or the whole project. - Fast Boolean text search tool for retreiving and coding text segments. - NVivo to QDA Miner Conversion Tool | https://provalisresearch.com/products/qualitative-data-analysis-software/freeware/ | ||
| Taguette | Free and open source tool for tagging | Free, allows collaboration on projects | Small to medium datasets | No visualization. Can only import one file at a time. Pretty basic | N/A | Hosted version, or you can self-host | Free - open source | Yes | No | azw, cbz, cbr, cbc, chm, djvu, doc, docx, epub, fb2, fbz, html, htmlz, lit, lrf, md, mobi, odt, pdf, prc, pdb, pml, rb, rtf, snb, tcr, txt, txtz | Can export codebooks as CSV, DOCX and export reports as DOCX, PDF, HTML | - Can install locally on desktop/laptop, on a server, or can use app.taguette.org for free - Free, open source software, easy to navigate - Wide variety of import/export options | https://taguette.org | |
| BangTheTable | Justice | https://www.bangthetable.com/ |
Instructions to keep this resource current
As technology and Artificial Intelligence advances, new analysis tools will be developed. This list is not exhaustive and is only current as of November 2019. As this Matrix is intended to be a “living document”, feel free to create a Pull Request GitHub or email us at serviceinnovationlab@dia.govt.nz to add/remove items to this matrix so that everyone can benefit from the latest information by pooling together our collective knowledge.