Questions tagged [text-processing]
The text-processing tag has no usage guidance.
140
questions
18
votes
12
answers
3k
views
Linux text editor that supports column manipulations/selections (like Notepad++ for Windows)
I'm looking for a gratis text editor for Linux that supports column manipulations/selection like the Notepad++ text editor for Windows allows.
Specifically, I want to be able to:
Quickly and easily ...
2
votes
2
answers
34
views
Generative AI detector for text (tells whether a text was written by a human or not)
I want to quickly tell whether a text was written by a human or by an AI (such as ChatGPT, GPT, LaMDA, BART, etc).
Ideally something that can be used online without installing anything, just with a ...
- 19.1k
1
vote
0
answers
10
views
What platform can I use to perform a machine-learning-based string matching process with a human-in-the-loop (HIL) aspect using python?
I am looking for a commendation on a hosted machine-learning process that provides an easy human-in-the-loop solution.
Our primary goal is to match strings from transactional data against our SSOT (...
- 11
2
votes
2
answers
38
views
Word separation sensitive text replacement CLI tool
I am looking for a Linux command-line utility that can do text replacement (think sed or sd) and is able to automatically extend your search-and-replace pattern to strings that have different word ...
- 426
0
votes
0
answers
10
views
Google Drive Tool That Can Update The indexableText attribute Of Files
TLDR: Google Drive does not index markdown files or mime type text/markdown by default. But Google Drive provides a method to index files with mime types that are not indexed by default by updating ...
1
vote
0
answers
38
views
Editor for all sorts of (Text) Files
The IT world is full of text files, for configuring things for defining things or for authoring text.
Since many years I've been searching a tool that can edit text files that have a user defined ...
- 111
0
votes
0
answers
11
views
GUI for source code documenting system, that can resolve references to comments in dual pane window?
I often have this problem, coding in C or Python: I start writing an expression, and it starts with a simple line comment, so far so good; say:
// initiate sending to hardware:
hardware_send_init(&...
- 151
0
votes
0
answers
3
views
DBpedia-Spotlight like tools for Chinese text?
I found a great tool DBpedia Spotlight to extract entities from text, but it seems that the spotter does not support Chinese. I wonder if there are some alternative open source repos which support ...
- 141
1
vote
1
answer
19
views
an AI text completer similar to tabnine
I am looking for an AI text completion extension for the browser that would display the next sentence like TabNine.
- 45
1
vote
1
answer
44
views
App to copy text from youtube video and paste into a terminal
On a linux machine, I watch many youtube videos associated with programming/coding. I would like to try out the code that is being presented in the youtube video. A useful app for me would be to be ...
- 181
1
vote
1
answer
12
views
Find duplicated or similar sentences from text in English
I would like a tool that takes input text and returns which sentences are duplicates and very similar (e.g., by informational distance as in Levenshtein distance). For example, if two sentences ...
0
votes
2
answers
92
views
Transform text into gibberish while maintains the "look" of the original text
I have some text. I want to generate gibberish instead of this text, but I want the gibberish to look the same, in the sense of being sequence of words of more-or-less the same lengths as the original ...
- 3,081
0
votes
0
answers
9
views
Tool or library to structure ingredient lists with relations
I am looking for a library (e.g. for python) or tool (e.g. to be used from terminal) that is able to structure a text that describes a dish in such a way that the semantics are preserved.
I found NLTK ...
- 133
0
votes
0
answers
12
views
Transforming web pages for ebook reader
I use getpocket.com for sending interesting articles to my ebook reader. This is useful as articles may be lengthy and ebook readers are better for this than a mobile phone.
But not every article goes ...
- 217
0
votes
1
answer
11
views
R library for matching similar names
I'm trying to join datasets with names that partially match, ex. "John Smith" vs. "Jonathan Q. Smith". I'm familiar with the fuzzy joins package and am wondering if there are other ...
- 101
0
votes
3
answers
163
views
Software to find & count duplicate strings in a text file
I am seeking recommendations for a Windows tool to find and count duplicate lines in a text file containing 500,000-999,999 lines.
The tool can be a CLI or GUI.
If the duplicate lines are consecutive ...
0
votes
0
answers
11
views
Looking for templated text extraction tool
I had a tool on Windows that I don't remember the name of and wondering if someone could help.
It was a very basic Windows GUI. I used it once to convert a Cisco firewall configuration into chunks of ...
0
votes
0
answers
12
views
C pre-preprocessing to enable module namespaces and keyword arguments
I need to write some C programs, however in general I find reading code written in this language considerably difficult. This is due to, I think, 2 factors: no module namespaces and no keyword ...
0
votes
0
answers
16
views
Regular expression search for multiple files with summary for Regex groups
I have a lot of files to search (17000+). I would like to search the file content using a regular expression. Unlike all programs that I know until now, I don't want to get a list of files (there will ...
- 9,795
1
vote
1
answer
9
views
R packages for text mining - beginner level
I am looking for a simple to use R package that will allow me to:
Analysis a chunk of text data for frequency
Easily allow me to exclude common terms e.g. "and" "yes"
Allow for ...
- 13
1
vote
3
answers
361
views
Is there something that can automatically align the equals sign (=) characters in text files?
We need to align the = character in our terraform files against the longest variable name. Is there any tool that can do this automatically?
For example
thomas = "train"
harrypotter = "...
- 151
1
vote
0
answers
20
views
Windows CLI tool to remove a specified line from a section within an `ini` file
Please recommend a gratis Windows CLI tool that allows one to remove a specified line from a section within an ini file.
For example, let's say you have the following ini file:
[settings]
height=100
...
1
vote
0
answers
42
views
Word processing software or other text-based tool that can "find" text with complex formatting
Follow up to my question here, I'm looking for word processing software or other text-based tool that can "find" text with complex (ie. formats not applied to the entire string) formatting, ...
- 111
0
votes
1
answer
25
views
Text Cleaning Tool
The online text tools on this page does almost everything one may need to “clean” the text in various ways. But often I need to perform multiple of those cleanings (for example replace smart quotes ...
- 247
0
votes
0
answers
30
views
Free Windows text search and replace across multiple files and directories (binary, archives office and PDF too would be nice)
One text search & replace to rule them all
We currently have 27 questions tagged text-search, and none of them really satisfy my requirements.
So, let's try for the one all-encompassing text ...
0
votes
1
answer
25
views
Looking for software / tool to shuffle alphabets / characters in text file
Looking for software / tool to shuffle alphabets / characters in text file,
Requirements:
use 1 password to shuffle and de-shuffle
correct password will de-shuffle the text file into its original ...
- 1
0
votes
1
answer
17
views
Using RegEx to automerge text files
I'm looking for a tool that will let me run a comparison on two files (A and B) and automatically copy changes from B to A if the text in B matches a regular expression. I've experimented with diff ...
1
vote
1
answer
82
views
want to convert OCR PDF to computer font
my pdf text is too blurry. so i want to convert it to computer font from scanned image.i already tried increassing quality by adobe/edit/preferences/page display.
Any OS is acceptable, any price. As ...
user71173
2
votes
1
answer
129
views
looking for python script to extract and reorganize tagged text
I am looking for a python script that will take a text file and extract and reorganize blocks of text in other files based on how those blocks are tagged. Before writing this myself (my coding is slow)...
- 23
3
votes
1
answer
68
views
Any software recommendations for getting the metadata of a PDF?
I have 10,000 PDF files in my drive and I need to capture the following metadata. I tried using wordstat but I'm unable to capture the following:
File Name
File Type
Asset Type
Asset Title
Product ...
- 41
1
vote
0
answers
31
views
Markdown formatter that converts inline links to reference-style links
I would like to find a CLI utility that replaces the inline links of a markdown file to reference-style links, a la this example.
On this website, I found a pandoc command that does something similar:
...
0
votes
0
answers
28
views
OCR software/application that transforms hand-written code to digitally-written code
What I am looking for is a software/application that takes a source code written by hand on a piece of paper and converts it to digital code in a clean, tidy, and orderly fashion. I do not want just ...
0
votes
0
answers
91
views
App or web-app to decode encoded strings (better than CyberChef's "magic")
I often have strings that are encoded with unknown encoding methods that I need to decode. Note that these strings are not encrypted; they are simply encoded.
I typically use CyberChef for these ...
2
votes
0
answers
231
views
Self-hosted OCR
I am looking for self-hosted OCR software.
Requirements:
Optical character recognition on images
Not just documents but also natural-scene-images
Linux Support
List item
Examples:
https://ocr.space/...
- 21
2
votes
1
answer
51
views
PDF editing software/note taking with indexing capability
I am a graduate student who is looking to upgrade my note taking capabilities. I am looking for a pdf editor (for windows 10) that can edit text (i.e highlight, underline, etc) but can also index ...
- 21
1
vote
1
answer
50
views
Find two text strings within N lines
I am looking for a gratis Windows program that can take a standard windows text file and search for occurrences of two user provided strings within N lines of each other, where N is user specified.
...
2
votes
3
answers
130
views
Terminal-based text editor for Linux with few dependencies
I'm using an old(ish) SLES Linux machine on which there are some issues with vi which I won't go into. I want to use another text editor - but none is installed as part of the distribution, and I'm ...
- 3,081
1
vote
0
answers
32
views
Editing text documents before feeding database
I hope this is the correct section for my question.
I need to paste 30 text files (they all have the same format, like 30 characters for the first column, 15 for the second one, and so on) one under ...
- 111
1
vote
1
answer
23
views
Batch Find/Replace within text file with savable/editable replace lists/presets
I am looking for software for Windows that provides a lot of functionality for Find/Replace batch operations on text files in folders.
A key feature is the ability to create batch lists of find/...
- 11
1
vote
2
answers
129
views
Visual scripting alternatives but for text ( text node editor )?
I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
- 11
2
votes
1
answer
31
views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
- 21
1
vote
1
answer
21
views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
- 111
1
vote
1
answer
1k
views
Doxygen for Protobuf files or similar tool with little modification to comment format?
I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
- 121
1
vote
1
answer
23
views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
- 11
1
vote
0
answers
187
views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
- 11
1
vote
0
answers
17
views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1
answer
26
views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
- 123
1
vote
1
answer
37
views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
- 269
1
vote
0
answers
24
views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
- 11
2
votes
2
answers
501
views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...