However, it represents all data in the form of strings, which is fine for simple constructs but makes it hard to use some advanced functionality. And there's often more than one implementation for each, so you can choose the exact algorithm or methodology you'd like to use. It implements pretty much any component of NLP you would need, like classification, tokenization, stemming, tagging, parsing, and semantic reasoning. It would be easy to argue that Natural Language Toolkit (NLTK) is the most full-featured tool of the ones I surveyed.

Python tools Natural Language Toolkit (NLTK) This is mostly because it's been many years since I last wrote in C++, and the organizations I've worked in have not used C++ for NLP or any data science work. Most of the libraries haven't been updated since that time-or they've only had a few updates.įinally, I excluded C++. It has been a couple of years since I last used Scala, when it was pretty popular. I was also surprised to see that the Scala libraries are fairly stagnant. I also chose languages and tools that are most likely to be used in production scenarios (rather than academia and research), and I have mostly used R as a research and discovery tool. That doesn't always mean they aren't being maintained well, but I think they should be getting updates more often to compete with other tools in the same space. The most obvious language I didn't include might be R, but most of the libraries I found hadn't been updated in over a year. (I didn't find a great selection of tools in the languages I'm not familiar with anyway.) That said, I excluded tools in three languages I am familiar with, for various reasons. There are a wide variety of open source NLP tools out there, so I decided to survey the landscape to help you plan your next voice- or text-based application.įor this review, I focused on tools that use languages I'm familiar with, even though I'm not familiar with all the tools. Natural language processing (NLP), the technology that powers all the chatbots, voice assistants, predictive text, and other speech/text applications that permeate our lives, has evolved significantly in the last few years. Running Kubernetes on your Raspberry Pi.A practical guide to home automation using open source tools.6 open source tools for staying organized.An introduction to programming with Bash.A guide to building a video game with Python.

Edit trees in chief architect library