Questions tagged [text-processing]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-1
votes
0answers
6 views

What's my metanym - subject and meta-subject discovery with a known taxonomy

I have been playing with lda2vec, Gensim and other great tools but so far have not been able to satisfy this story As a user wanting to know the subjects in a PDF I found, I want words examined for ...
0
votes
0answers
6 views

Complex text detection using .net c#

I am looking for a recommendation for a package, library or tool that will allow me to do complex text detection in an image using .Net The image will not be a plain text image, it will be a number ...
0
votes
0answers
12 views

File content comparison ignoring formatting and some punctuations

I want to test a tool that generates text files based on some X input (not relevant for this question). In order to be able to automate some tests and save time, I would like to know if there is a ...
0
votes
0answers
16 views

Creating word list file Text to Bin and vice versa

I have found an absolutely brilliant anagram solver. https://www.fourmilab.ch/anagram/#download the problem I have is that the wordlist he uses produces way too many results with words that are not ...
0
votes
0answers
5 views

Lemmatization of non modern texts

I'm curious about your experiences with lemmatization tools for non modern texts. Specifically, I'm interested in lemmatization tools for 18th and 19th century Spanish, French, Portuguese, Italian, ...
1
vote
2answers
15 views

Visual scripting alternatives but for text ( text node editor )?

I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
1
vote
0answers
7 views

Tool to script simple find & replace for a fixed set of text strings

On a Mac: Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
1
vote
1answer
12 views

module or software to preprocess simple variable substitution for JSON files?

I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme. Themes are in JSON format. I would also like to create a more unified color scheme. Let's say I tell my theme ...
1
vote
1answer
36 views

Doxygen for Protobuf files or similar tool with little modification to comment format?

I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
0
votes
0answers
2 views

Tool to find duplicate repeated groups of lines in log files?

I want to use it to reduce (either graphically collapsing the blocks or replacing the duplicate lines with a reference) the amount of text I need to read when when analyzing boot system log file. ...
0
votes
0answers
8 views

Text interpreter

I'm helping a friend who needs assistance in automating part of his job, but not sure how to start. He's working in a bidding department inside a construction company, and preparing the bidding ...
0
votes
0answers
13 views

Library that takes in text and generates a title for it?

Does there exist a library that takes a plain text article, essay, etc, and generates an appropriate/quasi-appropriate title for it? "Title" meaning: about 1 to 10 words that meaningfully reflect the ...
0
votes
0answers
7 views

Text based topic segmentation

I'm doing a university project. I need to find a good way to identify topics in a given text file, probably a log text file and divide it into smaller segments(Topically cohesive segments). I have ...
0
votes
0answers
14 views

Can I use Node.js for text analysis?

We have the transcript for millions of text files (range of a few terabytes). We want to make a statistic of what our users answered to a set of questions. We do not necessary look for natural ...
0
votes
1answer
10 views

File Data Processor

I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance: - A node loads the ...
1
vote
0answers
22 views

Free API for handwritten OCR (Optical Character Recognition)

I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
1
vote
0answers
11 views

Utility to create word list from a document

I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.). A bonus would be if it gave a count ...
1
vote
1answer
22 views

Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'

I need to answer those two questions: Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text? If so: ...
1
vote
1answer
35 views

Cheap or free convenient application for making subtitles?

I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
0
votes
0answers
5 views

Automatic/semi-automatic construction of an ontology out of an encyclopedia

I have to build a knowledge base of the domain class of insurance (country specific -> Switzerland). The expected result is the following: An ontology with classes, subclasses, data properties etc ...
1
vote
0answers
7 views

Web-based Grep app

I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets. I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
0
votes
0answers
20 views

Software to find duplicate paragraphs or phrases in multiple microsoft word documents

Here is my condition: I have many drafts microsoft word documents. I want to make one microsoft word document. Therefore, I need to find duplicate words or paragraphs copy them into final document ...
1
vote
2answers
36 views

Software to search for duplicate lines within a text file

I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them. The order of ...
0
votes
0answers
14 views

Formatting large amounts of differently structured ascii text snippets into a uniform format

we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html. The text snippets can be plain ...
0
votes
0answers
30 views

Are the application for transcribing audio into subtitles?

There is such application as gTranscribe that allows you to play audio and type text into the text area below and it puts time stamp automatically at the and of each line. Are there something similar, ...
0
votes
0answers
7 views

I am looking for some existing library or code that can convert my Unicode hindi text to KrutiDev Devanagri?

Can someone recommend any code or existing library in any python? If not python any language will be fine.
0
votes
0answers
11 views

Library or framework for flat file handling?

I'd started a new job recently and am in the process of learning about / taking ownership over some of the existing systems that we've got in place. Within the past few days I'd discovered that one ...
0
votes
1answer
16 views

Text/macro expansion program

I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string". E.g. -abc- expands to ...
0
votes
0answers
14 views

OCR for LCD Display (must deal light and shadows zones)

I see that most people use OCR for documents and license plates. I need to solve a problem using OCR to recognize characters (numbers) in a LCD display and transform into text (after that put that ...
0
votes
1answer
33 views

Software that can convert large amount of data to md5 hash

Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
1
vote
2answers
61 views

Preprocessor for Windows, good for generating HTML files

I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
0
votes
0answers
3 views

software to detect repeated text phrases (full sentence followed by identical phrase from that sentence)

Stackexchangers, I have a couple of hundred XML texts, which contain textual repetitions of the following type: In cases where exceptional balance of payments difficulties exist, and then for a ...
0
votes
0answers
9 views

Extracting tabular data from HTML pages

I need to examine an HTML page with a listing of multiple items (people, media files etc.) - having some elements of data per item: Links, numbers, strings etc. - and placing the results in a plain, ...
1
vote
0answers
13 views

Text classification using Python

I am doing a text classification related task in Python using NLP and SkLearn. I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
0
votes
0answers
11 views

(Semantic) Highlighting of any text for improved speed reading

I'm looking for an application that is able to process the (semantic) content of a text and provides an easier-to-read output. I'm imagining an app that takes Text (e.g., in PDF format) and provides a ...
1
vote
1answer
36 views

How can I delete non-english words from text file?

I want to delete all words, which are not English, from the text file. I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
0
votes
1answer
20 views

XML libraries for java

Please succintly summarize the licensing and vendor implementations available for: XQuery JAXP XQJ specific to Java and where the libraries can be found for build files.
4
votes
5answers
66 views

Copy & paste texts omitting leading/trailing white spaces

Looking for utility/macro/plugin to paste texts from clipboard omitting leading/trailing white spaces. Couldn't find this feature in macros in PhraseExpress or utilities like PureText. Thanks.
0
votes
1answer
26 views

WWW: Many pages to one?

We have a documentation/help system in the form of 'a lot of www pages (one-topic-per-page)'. Is there any ready-to-go software/script able to change that docs to 'all-in-one-page' format?
2
votes
1answer
31 views

Utility to recursively process text file templates and fill in placeholders

I search for a tool that is / can: gratis free from dependencies (no scripting language interpreter needed, ...) preferably a single binary run on Linux, optionally Windows traverse a (sub)directory ...
1
vote
0answers
19 views

Looking for text list merge program

I'm looking for a program that can combine several lists. Must be Windows supported, completely free or freemium, has an interface and unicode supported. It should be able to add prefix, suffix and ...
0
votes
1answer
28 views

Headline Capitalization

Background Developers write JIRA tickets; developers do not style the ticket items consistently. We'd like to present the ticket summaries to clients, but with a consistent format. Problem We're ...
1
vote
1answer
93 views

Language detection at shell command

I need to detect the language of a huge amount of files, and I was wondering if there is some tool which I could use in a way similar to this, in linux command shell: langdetector filetodetect > ...
2
votes
1answer
37 views

Getting marked up difference of two big normal texts (not source code)

How to get difference text of two ebooks converted to plain text? They are both the same book but different editions, so much of text is exactly the same to within hyphenation and punctuation changes. ...
2
votes
0answers
78 views

Software to convert very, very large html file to markdown

I have a single 1.3gb html file that contains the entirety of the Encyclopedia Britannica. I want to convert it to markdown in a way that preserves subheadings, tables, and UTF-8 special characters. ...
2
votes
0answers
9 views

Textual authorship testing options?

There's a pretty remarkable piece of software called jstylo from Drexel University, but it appears to have been untouched for a couple of years. Are there any comparable options to this that analyze ...
0
votes
1answer
142 views

Convert JSPWiki to XWiki

Background Looking to convert a document written in JSPWiki format to a file written in any format supported by pandoc. Requirements Preferably CommonMark or basic HTML output. No attachments. No ...
2
votes
1answer
59 views

Is there a very simple version control tool that only uses a diff-based change log for a text file?

Parsing the change log and reconstructing an older version automatically is not a requirement. The only objective is to make everything I ever wrote and saved and potentially deleted searchable and ...
0
votes
0answers
42 views

Open source tool to extract text from developer file types

I would like to parse the text content from these developer file types and index them and make them available for my lucene search engine for search. I would like to parse the text content from these ...
1
vote
0answers
50 views

Open source tool to do OCR

I would like to parse the text content (OCR) from these image file types and index them and make them available for my lucene search engine for search. .ai .bmp .gif .jpeg .jpg .png .psd .ttf Can ...