Questions tagged [text-processing]
The text-processing tag has no usage guidance.
130
questions
0
votes
0
answers
5
views
Tool or library to structure ingredient lists with relations
I am looking for a library (e.g. for python) or tool (e.g. to be used from terminal) that is able to structure a text that describes a dish in such a way that the semantics are preserved.
I found NLTK ...
- 133
0
votes
0
answers
9
views
Transforming web pages for ebook reader
I use getpocket.com for sending interesting articles to my ebook reader. This is useful as articles may be lengthy and ebook readers are better for this than a mobile phone.
But not every article goes ...
- 217
0
votes
1
answer
9
views
R library for matching similar names
I'm trying to join datasets with names that partially match, ex. "John Smith" vs. "Jonathan Q. Smith". I'm familiar with the fuzzy joins package and am wondering if there are other ...
- 101
0
votes
3
answers
40
views
Software to find & count duplicate strings in a text file
I am seeking recommendations for a Windows tool to find and count duplicate lines in a text file containing 500,000-999,999 lines.
The tool can be a CLI or GUI.
If the duplicate lines are consecutive ...
0
votes
0
answers
11
views
Looking for templated text extraction tool
I had a tool on Windows that I don't remember the name of and wondering if someone could help.
It was a very basic Windows GUI. I used it once to convert a Cisco firewall configuration into chunks of ...
0
votes
0
answers
12
views
C pre-preprocessing to enable module namespaces and keyword arguments
I need to write some C programs, however in general I find reading code written in this language considerably difficult. This is due to, I think, 2 factors: no module namespaces and no keyword ...
0
votes
0
answers
12
views
Regular expression search for multiple files with summary for Regex groups
I have a lot of files to search (17000+). I would like to search the file content using a regular expression. Unlike all programs that I know until now, I don't want to get a list of files (there will ...
- 9,505
0
votes
0
answers
8
views
Text annotation - multi class paragraph tagging
I'm looking for a very simple text annotation tool which can:
Allow me to upload text documents.
Allow me to tag sections of the text at the paragraph level (I can also split the documents into ...
- 113
1
vote
1
answer
8
views
R packages for text mining - beginner level
I am looking for a simple to use R package that will allow me to:
Analysis a chunk of text data for frequency
Easily allow me to exclude common terms e.g. "and" "yes"
Allow for ...
- 13
1
vote
3
answers
203
views
Is there something that can automatically align the equals sign (=) characters in text files?
We need to align the = character in our terraform files against the longest variable name. Is there any tool that can do this automatically?
For example
thomas = "train"
harrypotter = "...
- 141
1
vote
0
answers
19
views
Windows CLI tool to remove a specified line from a section within an `ini` file
Please recommend a gratis Windows CLI tool that allows one to remove a specified line from a section within an ini file.
For example, let's say you have the following ini file:
[settings]
height=100
...
1
vote
0
answers
39
views
Word processing software or other text-based tool that can "find" text with complex formatting
Follow up to my question here, I'm looking for word processing software or other text-based tool that can "find" text with complex (ie. formats not applied to the entire string) formatting, ...
- 111
0
votes
1
answer
23
views
Text Cleaning Tool
The online text tools on this page does almost everything one may need to “clean” the text in various ways. But often I need to perform multiple of those cleanings (for example replace smart quotes ...
- 247
0
votes
0
answers
29
views
Free Windows text search and replace across multiple files and directories (binary, archives office and PDF too would be nice)
One text search & replace to rule them all
We currently have 27 questions tagged text-search, and none of them really satisfy my requirements.
So, let's try for the one all-encompassing text ...
0
votes
1
answer
19
views
Looking for software / tool to shuffle alphabets / characters in text file
Looking for software / tool to shuffle alphabets / characters in text file,
Requirements:
use 1 password to shuffle and de-shuffle
correct password will de-shuffle the text file into its original ...
- 1
0
votes
1
answer
17
views
Using RegEx to automerge text files
I'm looking for a tool that will let me run a comparison on two files (A and B) and automatically copy changes from B to A if the text in B matches a regular expression. I've experimented with diff ...
1
vote
1
answer
80
views
want to convert OCR PDF to computer font
my pdf text is too blurry. so i want to convert it to computer font from scanned image.i already tried increassing quality by adobe/edit/preferences/page display.
Any OS is acceptable, any price. As ...
user71173
2
votes
1
answer
84
views
looking for python script to extract and reorganize tagged text
I am looking for a python script that will take a text file and extract and reorganize blocks of text in other files based on how those blocks are tagged. Before writing this myself (my coding is slow)...
- 23
2
votes
1
answer
53
views
Any software recommendations for getting the metadata of a PDF?
I have 10,000 PDF files in my drive and I need to capture the following metadata. I tried using wordstat but I'm unable to capture the following:
File Name
File Type
Asset Type
Asset Title
Product ...
- 31
1
vote
0
answers
24
views
Markdown formatter that converts inline links to reference-style links
I would like to find a CLI utility that replaces the inline links of a markdown file to reference-style links, a la this example.
On this website, I found a pandoc command that does something similar:
...
0
votes
0
answers
26
views
OCR software/application that transforms hand-written code to digitally-written code
What I am looking for is a software/application that takes a source code written by hand on a piece of paper and converts it to digital code in a clean, tidy, and orderly fashion. I do not want just ...
0
votes
0
answers
75
views
App or web-app to decode encoded strings (better than CyberChef's "magic")
I often have strings that are encoded with unknown encoding methods that I need to decode. Note that these strings are not encrypted; they are simply encoded.
I typically use CyberChef for these ...
2
votes
0
answers
171
views
Self-hosted OCR
I am looking for self-hosted OCR software.
Requirements:
Optical character recognition on images
Not just documents but also natural-scene-images
Linux Support
List item
Examples:
https://ocr.space/...
- 21
1
vote
1
answer
40
views
Find two text strings within N lines
I am looking for a gratis Windows program that can take a standard windows text file and search for occurrences of two user provided strings within N lines of each other, where N is user specified.
...
2
votes
3
answers
82
views
Terminal-based text editor for Linux with few dependencies
I'm using an old(ish) SLES Linux machine on which there are some issues with vi which I won't go into. I want to use another text editor - but none is installed as part of the distribution, and I'm ...
- 2,932
1
vote
0
answers
32
views
Editing text documents before feeding database
I hope this is the correct section for my question.
I need to paste 30 text files (they all have the same format, like 30 characters for the first column, 15 for the second one, and so on) one under ...
- 111
1
vote
1
answer
22
views
Batch Find/Replace within text file with savable/editable replace lists/presets
I am looking for software for Windows that provides a lot of functionality for Find/Replace batch operations on text files in folders.
A key feature is the ability to create batch lists of find/...
- 11
1
vote
2
answers
96
views
Visual scripting alternatives but for text ( text node editor )?
I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
- 11
2
votes
1
answer
30
views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
- 21
1
vote
1
answer
19
views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
- 111
1
vote
1
answer
740
views
Doxygen for Protobuf files or similar tool with little modification to comment format?
I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
- 21
0
votes
0
answers
26
views
Can I use Node.js for text analysis?
We have the transcript for millions of text files (range of a few terabytes). We want to make a statistic of what our users answered to a set of questions. We do not necessary look for natural ...
- 101
1
vote
1
answer
22
views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
- 11
1
vote
0
answers
181
views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
- 11
1
vote
0
answers
16
views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1
answer
25
views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
- 123
1
vote
1
answer
37
views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
- 269
1
vote
0
answers
18
views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
- 11
2
votes
2
answers
316
views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...
0
votes
0
answers
19
views
Formatting large amounts of differently structured ascii text snippets into a uniform format
we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html.
The text snippets can be plain ...
- 1
0
votes
0
answers
43
views
Are the application for transcribing audio into subtitles?
There is such application as gTranscribe that allows you to play audio and type text into the text area below and it puts time stamp automatically at the and of each line. Are there something similar, ...
- 269
0
votes
1
answer
43
views
Text/macro expansion program
I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string".
E.g. -abc- expands to ...
user416
0
votes
1
answer
37
views
Software that can convert large amount of data to md5 hash
Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
- 1
1
vote
2
answers
135
views
Preprocessor for Windows, good for generating HTML files
I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
- 163
1
vote
2
answers
56
views
Text classification using Python
I am doing a text classification related task in Python using NLP and SkLearn.
I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
- 11
1
vote
1
answer
480
views
How can I delete non-english words from text file?
I want to delete all words, which are not English, from the text file.
I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
- 163
0
votes
1
answer
43
views
XML libraries for java
Please succintly summarize the licensing and vendor implementations available for:
XQuery
JAXP
XQJ
specific to Java and where the libraries can be found for build files.
- 103
4
votes
5
answers
99
views
Copy & paste texts omitting leading/trailing white spaces
Looking for utility/macro/plugin to paste texts from clipboard omitting leading/trailing white spaces.
Couldn't find this feature in macros in PhraseExpress or utilities like PureText.
Thanks.
- 51
0
votes
1
answer
27
views
WWW: Many pages to one?
We have a documentation/help system in the form of 'a lot of www pages (one-topic-per-page)'.
Is there any ready-to-go software/script able to change that docs to 'all-in-one-page' format?
- 3
2
votes
1
answer
58
views
Utility to recursively process text file templates and fill in placeholders
I search for a tool that is / can:
gratis
free from dependencies (no scripting language interpreter needed, ...)
preferably a single binary
run on Linux, optionally Windows
traverse a (sub)directory ...
- 317