Over the last years natural language processing (further NLP) field was growing rapidly. In 2020 NLP world market was valued at $13,6 billion. According to forecasts this market segment will have a growth in future and by 2026 its value will achieve $42,04 billion, herewith 85% of enterprise activity will be made without human involvement.
Besides powerful NLP market players like Google, Microsoft, Amazon, IBM, Apple that continue to develop and improve upon their products, there are a lot of new startup companies (42Chat, Canary Speech, Gamalon, Green Key Technologies).
Development of greatest relevance at latest:
- BERT (Bidirectional Encoder Representations from Transformers) is a mainstay of Google. Due to ability to analyze a request as a whole sentence (with preposition and conjunction) and focus on a context it provides selection of relevant search results. BERT works in 72 languages.
- ELECTRA (Efficiently Learning an Encoder that Classifies Token Replacements Accurately) – the new Google development. They safe all BERTs’ benefits and made ELECTRA an encoder that learns effectively and classifies accurately replaced tokens. Consequently, it has an edge over previous development without increase of computer power costs.
- GPT-3 (Generative Pre-trained Transformer) – Open-AI 3rd version of NLP algorithm that based on Transformer architecture. Currently the new version is the biggest language model (175B characteristics).
