Questions tagged [text-processing]
The text-processing tag has no usage guidance.
120
questions
0
votes
0answers
6 views
Text (numerical) recognition software for amateur laboratory use
I'm looking for a piece of software (or library in python, c++...) that could in general automatically recognize numbers displayed on multimeters' screens in lab setting. Given video file I want to ...
1
vote
3answers
45 views
Terminal-based text editor for Linux with few dependencies
I'm using an old(ish) SLES Linux machine on which there are some issues with vi which I won't go into. I want to use another text editor - but none is installed as part of the distribution, and I'm ...
1
vote
0answers
23 views
Editing text documents before feeding database
I hope this is the correct section for my question.
I need to paste 30 text files (they all have the same format, like 30 characters for the first column, 15 for the second one, and so on) one under ...
1
vote
1answer
16 views
Batch Find/Replace within text file with savable/editable replace lists/presets
I am looking for software for Windows that provides a lot of functionality for Find/Replace batch operations on text files in folders.
A key feature is the ability to create batch lists of find/...
0
votes
0answers
13 views
Is there an online tool that cuts off subdomains and leaves only domains?
Is there a tool to which I can give a list of path names (google.com, test.something.co.uk, bla.anothersomething.club, etc.) and it will give me a list of root domains (in this case google.com, ...
0
votes
0answers
3 views
Converting a TextBase Project RoadMap to Graphics
Please have a look at https://yuml.me/diagram/scruffy/class/draw. This site automatically draw UML graphics from text. This release you form using any graphical tools.
Now please have a look at ...
0
votes
0answers
20 views
200 million rows and 60GB file processing
There is one file.
The file has 200 million rows and is 60 GB in size.
I want to paging the rows of that file.
ascii text file sample payload
aaa,bbb,ccc,ddd,ggg
aaa,bbb,ccc,ddd,ggg
aaa,bbb,ccc,...
0
votes
0answers
7 views
Complex text detection using .net c#
I am looking for a recommendation for a package, library or tool that will allow me to do complex text detection in an image using .Net
The image will not be a plain text image, it will be a number ...
0
votes
0answers
12 views
File content comparison ignoring formatting and some punctuations
I want to test a tool that generates text files based on some X input (not relevant for this question).
In order to be able to automate some tests and save time, I would like to know if there is a ...
0
votes
0answers
17 views
Creating word list file Text to Bin and vice versa
I have found an absolutely brilliant anagram solver.
https://www.fourmilab.ch/anagram/#download
the problem I have is that the wordlist he uses produces way too many results with words that are not ...
0
votes
0answers
7 views
Lemmatization of non modern texts
I'm curious about your experiences with lemmatization tools for non modern texts. Specifically, I'm interested in lemmatization tools for 18th and 19th century Spanish, French, Portuguese, Italian, ...
1
vote
2answers
24 views
Visual scripting alternatives but for text ( text node editor )?
I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
2
votes
1answer
20 views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
1
vote
1answer
12 views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
1
vote
1answer
175 views
Doxygen for Protobuf files or similar tool with little modification to comment format?
I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
0
votes
0answers
2 views
Tool to find duplicate repeated groups of lines in log files?
I want to use it to reduce (either graphically collapsing the blocks or replacing the duplicate lines with a reference) the amount of text I need to read when when analyzing boot system log file.
...
0
votes
0answers
9 views
Text interpreter
I'm helping a friend who needs assistance in automating part of his job, but not sure how to start.
He's working in a bidding department inside a construction company, and preparing the bidding ...
0
votes
0answers
14 views
Library that takes in text and generates a title for it?
Does there exist a library that takes a plain text article, essay, etc, and generates an appropriate/quasi-appropriate title for it? "Title" meaning: about 1 to 10 words that meaningfully reflect the ...
0
votes
0answers
11 views
Text based topic segmentation
I'm doing a university project. I need to find a good way to identify topics in a given text file, probably a log text file and divide it into smaller segments(Topically cohesive segments). I have ...
0
votes
0answers
15 views
Can I use Node.js for text analysis?
We have the transcript for millions of text files (range of a few terabytes). We want to make a statistic of what our users answered to a set of questions. We do not necessary look for natural ...
1
vote
1answer
20 views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
1
vote
0answers
125 views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
1
vote
0answers
11 views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1answer
23 views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
1
vote
1answer
35 views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
0
votes
0answers
5 views
Automatic/semi-automatic construction of an ontology out of an encyclopedia
I have to build a knowledge base of the domain class of insurance (country specific -> Switzerland).
The expected result is the following:
An ontology with classes, subclasses, data properties etc ...
1
vote
0answers
8 views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
0
votes
0answers
31 views
Software to find duplicate paragraphs or phrases in multiple microsoft word documents
Here is my condition:
I have many drafts microsoft word documents.
I want to make one microsoft word document.
Therefore,
I need to
find duplicate words or paragraphs
copy them into final document ...
2
votes
2answers
50 views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...
0
votes
0answers
14 views
Formatting large amounts of differently structured ascii text snippets into a uniform format
we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html.
The text snippets can be plain ...
0
votes
0answers
35 views
Are the application for transcribing audio into subtitles?
There is such application as gTranscribe that allows you to play audio and type text into the text area below and it puts time stamp automatically at the and of each line. Are there something similar, ...
0
votes
1answer
23 views
Text/macro expansion program
I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string".
E.g. -abc- expands to ...
0
votes
1answer
35 views
Software that can convert large amount of data to md5 hash
Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
1
vote
2answers
78 views
Preprocessor for Windows, good for generating HTML files
I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
1
vote
1answer
21 views
Text classification using Python
I am doing a text classification related task in Python using NLP and SkLearn.
I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
1
vote
1answer
109 views
How can I delete non-english words from text file?
I want to delete all words, which are not English, from the text file.
I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
0
votes
1answer
26 views
XML libraries for java
Please succintly summarize the licensing and vendor implementations available for:
XQuery
JAXP
XQJ
specific to Java and where the libraries can be found for build files.
4
votes
5answers
74 views
Copy & paste texts omitting leading/trailing white spaces
Looking for utility/macro/plugin to paste texts from clipboard omitting leading/trailing white spaces.
Couldn't find this feature in macros in PhraseExpress or utilities like PureText.
Thanks.
0
votes
1answer
27 views
WWW: Many pages to one?
We have a documentation/help system in the form of 'a lot of www pages (one-topic-per-page)'.
Is there any ready-to-go software/script able to change that docs to 'all-in-one-page' format?
2
votes
1answer
33 views
Utility to recursively process text file templates and fill in placeholders
I search for a tool that is / can:
gratis
free from dependencies (no scripting language interpreter needed, ...)
preferably a single binary
run on Linux, optionally Windows
traverse a (sub)directory ...
1
vote
0answers
19 views
Looking for text list merge program
I'm looking for a program that can combine several lists.
Must be Windows supported, completely free or freemium, has an interface and unicode supported. It should be able to add prefix, suffix and ...
0
votes
1answer
29 views
Headline Capitalization
Background
Developers write JIRA tickets; developers do not style the ticket items consistently. We'd like to present the ticket summaries to clients, but with a consistent format.
Problem
We're ...
1
vote
1answer
185 views
Language detection at shell command
I need to detect the language of a huge amount of files, and I was wondering if there is some tool which I could use in a way similar to this, in linux command shell:
langdetector filetodetect > ...
2
votes
1answer
41 views
Get difference of two regular literature texts (not source code), with markup on changes
How to get difference text of two ebooks converted to plain text?
They are both the same book but different editions, so much of text is exactly the same to within hyphenation and punctuation changes.
...
2
votes
0answers
80 views
Software to convert very, very large html file to markdown
I have a single 1.3gb html file that contains the entirety of the Encyclopedia Britannica. I want to convert it to markdown in a way that preserves subheadings, tables, and UTF-8 special characters.
...
2
votes
0answers
9 views
Textual authorship testing options?
There's a pretty remarkable piece of software called jstylo from Drexel University, but it appears to have been untouched for a couple of years.
Are there any comparable options to this that analyze ...
0
votes
1answer
199 views
Convert JSPWiki to XWiki
Background
Looking to convert a document written in JSPWiki format to a file written in any format supported by pandoc.
Requirements
Preferably CommonMark or basic HTML output.
No attachments.
No ...
2
votes
1answer
60 views
Is there a very simple version control tool that only uses a diff-based change log for a text file?
Parsing the change log and reconstructing an older version automatically is not a requirement. The only objective is to make everything I ever wrote and saved and potentially deleted searchable and ...
0
votes
0answers
49 views
Open source tool to extract text from developer file types
I would like to parse the text content from these developer file types and index them and make them available for my lucene search engine for search.
I would like to parse the text content from these ...
1
vote
0answers
53 views
Open source tool to do OCR
I would like to parse the text content (OCR) from these image file types and index them and make them available for my lucene search engine for search.
.ai .bmp .gif .jpeg .jpg .png .psd .ttf
Can ...
