Questions tagged [text-processing]
Software related to processing text in any way, e.g. formatting, filtering, searching and replacing, etc.
154 questions
0
votes
1
answer
24
views
Gratis Windows command line app to delete all lines in a text file which contain a given string
I am trying to see the wood for the trees in a very large log file. There are several sets of oft repeated lines which I would like to delete, in order to make things more legible.
I can do it with ...
- 9,175
1
vote
1
answer
53
views
When awk becomes too cumbersome, what is the next classic Unix tool to consider to deal with text transformation?
Awk is invaluable for many purposes where text filter logic spans multiple lines and you need to maintain state (unlike grep and sed), but as I'm finding lately there may be cases where you need ...
- 267
2
votes
0
answers
12
views
Software/web service that can extract quoted text and attributions from fiction
I have need of a tool that can read through a (potentially long) work of fiction (e.g. short story, novel, etc) and find instances where a character speaks and provide as output the name of the ...
- 121
2
votes
0
answers
25
views
CPU-based LLM for Markdown editor
I'd like to integrate an LLM into my free, open-source, cross-platform desktop Markdown editor. In particular, bundle the LLM into the editor's ancillary podman container (that's used for typesetting)....
- 742
0
votes
0
answers
17
views
Math accessibility for math kids on Android via Gboard (or other comfortable math keyboard) via plugins and software engineering
I tried posting this on the TeX - LaTeX stack exchange, but couldn't because I kept getting an error (I couldn't identify the error).
I am looking for a predictive system I want to use on Android to ...
0
votes
0
answers
117
views
Blur pdf document
I am looking for a tool to blur a pdf document like below; so far I found only online and offline tools to black out text (e.g. Adobe, smallpdf, redactpdf, pdffiller etc.).
0
votes
0
answers
317
views
Unblur pdf document
I've a pdf document and some pages are blurred (see figure below please). I tried to unblur it by using ScanWritr and AvePDF, but without any success.
Could you suggest me a tool to do that please?
0
votes
0
answers
13
views
Dictation: computer speaks, learner writes
I am wondering whether there is any software on the Android Google Play store that does the following:
Text is read out
The software waits for the text that is read out to be written at the keyboard....
2
votes
1
answer
91
views
Is there a (command line) tool to calculate percentage change between two files of the same format full of numbers?
Is there a (command line) tool to calculate percentage change between two files of the same format full of numbers?
Example:
File A:
100 100
File B:
150 70
Invocation:
$ calc_perc_change A B
+50% -...
- 165
2
votes
0
answers
36
views
Extracting font from a handwritten pdf file
I'm wondering if it's possible to extract (create actually) the font from a handwritten pdf file. Online I found only methods to create a font starting from my own handwriting.
There are projects like ...
- 151
1
vote
0
answers
19
views
Looking for tools to summarize or quiz from large PDF/text files
Claude AI chatbot provides the ability to summarize PDF/texts. But it still has a limit, usually if one wants to create a summary of a book the pdf/text file has a lot of words exceeding the limit ...
- 141
0
votes
1
answer
76
views
OCR extraction from scans
I really need your help!
I have been tasked by my university to digitise a whole bunch of historical data. These are old scans from books and my task would be to copy the data by hand.
Since this task ...
0
votes
0
answers
27
views
Software type for processing an author's works
I look for a category of software, not concrete software packages. Of course if you name some, that wouldn't hurt.
I am to process the works of an author. In the past century this was called writing ...
- 217
0
votes
0
answers
10
views
Does a tool exist that allows one to comb through the ai literature?
Does a tool exists, and I am specifically thinking of something LLM-based, that allow to ask such things as for example : “make me a timeline of the major papers in the field of object detection”, “...
1
vote
1
answer
38
views
grep tool that colorizes matches and (C) code comments?
This is somewhat similar to the question in https://unix.stackexchange.com/questions/33131/how-to-grep-on-source-code-without-catching-comments - however, what I actually want, is this: provided a C ...
- 241
2
votes
1
answer
120
views
Frontend to AI system (LLM) plugin for transforming longer text chunks to simple modern language
How to translate/rephrase a verse epic in unreadable language (with bad typesetting) to modern spoken languages?
I intend to purchase an ebook of the Iliad by Homer.
This is a translation from ancient ...
- 3,110
0
votes
1
answer
46
views
Template engine / tool that can template out whole directory trees
What I'm looking for
I'm looking for a text templating engine (think e.g. Jinja2, Mako, or Liquid) or a higher-level library/tool making use of such an engine that supports templating on the level of ...
- 591
2
votes
0
answers
20
views
Tool to keep duplicate information in source code repository consistent
Sometimes it can't be avoided to duplicate information in a source code repository: E.g. parts of the README file will often be duplicated in the full documentation, the current version will often be ...
- 591
1
vote
1
answer
92
views
Is there software to change 'е' to 'ё' in Russian text?
Can anyone tell me if there is a downloadable software program that will change 'е' to 'ё' when appropriate for beginning readers? I found one called Орфо but the links were either outdated or didn't ...
Chris Carr
20
votes
12
answers
6k
views
Linux text editor that supports column manipulations/selections (like Notepad++ for Windows)
I'm looking for a gratis text editor for Linux that supports column manipulations/selection like the Notepad++ text editor for Windows allows.
Specifically, I want to be able to:
Quickly and easily ...
- 7,034
2
votes
2
answers
264
views
Generative AI detector for text (tells whether a text was written by a human or not)
I want to quickly tell whether a text was written by a human or by an AI (such as ChatGPT, GPT, LaMDA, BART, etc).
Ideally something that can be used online without installing anything, just with a ...
- 19.7k
1
vote
0
answers
39
views
What platform can I use to perform a machine-learning-based string matching process with a human-in-the-loop (HIL) aspect using python?
I am looking for a commendation on a hosted machine-learning process that provides an easy human-in-the-loop solution.
Our primary goal is to match strings from transactional data against our SSOT (...
- 11
2
votes
2
answers
44
views
Word separation sensitive text replacement CLI tool
I am looking for a Linux command-line utility that can do text replacement (think sed or sd) and is able to automatically extend your search-and-replace pattern to strings that have different word ...
- 591
1
vote
0
answers
47
views
Google Drive Tool That Can Update The indexableText attribute Of Files
TLDR: Google Drive does not index markdown files or mime type text/markdown by default. But Google Drive provides a method to index files with mime types that are not indexed by default by updating ...
- 11
1
vote
0
answers
43
views
Editor for all sorts of (Text) Files
The IT world is full of text files, for configuring things for defining things or for authoring text.
Since many years I've been searching a tool that can edit text files that have a user defined ...
- 111
0
votes
0
answers
19
views
GUI for source code documenting system, that can resolve references to comments in dual pane window?
I often have this problem, coding in C or Python: I start writing an expression, and it starts with a simple line comment, so far so good; say:
// initiate sending to hardware:
hardware_send_init(&...
- 241
1
vote
1
answer
30
views
an AI text completer similar to tabnine
I am looking for an AI text completion extension for the browser that would display the next sentence like TabNine.
- 55
2
votes
3
answers
275
views
App to copy text from youtube video and paste into a terminal
On a Linux machine, I watch many youtube videos associated with programming/coding. I would like to try out the code that is being presented in the youtube video. A useful app for me would be to be ...
- 209
1
vote
1
answer
99
views
Find duplicated or similar sentences from text in English
I would like a tool that takes input text and returns which sentences are duplicates and very similar (e.g., by informational distance as in Levenshtein distance). For example, if two sentences ...
1
vote
2
answers
776
views
Transform text into gibberish while maintains the "look" of the original text
I have some text. I want to generate gibberish instead of this text, but I want the gibberish to look the same, in the sense of being sequence of words of more-or-less the same lengths as the original ...
- 3,369
1
vote
1
answer
30
views
R library for matching similar names
I'm trying to join datasets with names that partially match, ex. "John Smith" vs. "Jonathan Q. Smith". I'm familiar with the fuzzy joins package and am wondering if there are other ...
- 111
0
votes
3
answers
797
views
Software to find & count duplicate strings in a text file
I am seeking recommendations for a Windows tool to find and count duplicate lines in a text file containing 500,000-999,999 lines.
The tool can be a CLI or GUI.
If the duplicate lines are consecutive ...
- 7,034
0
votes
0
answers
57
views
Regular expression search for multiple files with summary for Regex groups
I have a lot of files to search (17000+). I would like to search the file content using a regular expression. Unlike all programs that I know until now, I don't want to get a list of files (there will ...
- 10.5k
1
vote
1
answer
9
views
R packages for text mining - beginner level
I am looking for a simple to use R package that will allow me to:
Analysis a chunk of text data for frequency
Easily allow me to exclude common terms e.g. "and" "yes"
Allow for ...
- 13
1
vote
3
answers
998
views
Is there something that can automatically align the equals sign (=) characters in text files?
We need to align the = character in our terraform files against the longest variable name. Is there any tool that can do this automatically?
For example
thomas = "train"
harrypotter = "...
- 151
1
vote
0
answers
28
views
Windows CLI tool to remove a specified line from a section within an `ini` file
Please recommend a gratis Windows CLI tool that allows one to remove a specified line from a section within an ini file.
For example, let's say you have the following ini file:
[settings]
height=100
...
- 7,034
1
vote
0
answers
44
views
Word processing software or other text-based tool that can "find" text with complex formatting
Follow up to my question here, I'm looking for word processing software or other text-based tool that can "find" text with complex (ie. formats not applied to the entire string) formatting, ...
- 111
0
votes
1
answer
45
views
Text Cleaning Tool
The online text tools on this page does almost everything one may need to “clean” the text in various ways. But often I need to perform multiple of those cleanings (for example replace smart quotes ...
- 247
0
votes
0
answers
59
views
Free Windows text search and replace across multiple files and directories (binary, archives office and PDF too would be nice)
One text search & replace to rule them all
We currently have 27 questions tagged text-search, and none of them really satisfy my requirements.
So, let's try for the one all-encompassing text ...
- 9,175
1
vote
1
answer
39
views
Looking for software / tool to shuffle alphabets / characters in text file
Looking for software / tool to shuffle alphabets / characters in text file,
Requirements:
use 1 password to shuffle and de-shuffle
correct password will de-shuffle the text file into its original ...
- 11
0
votes
1
answer
26
views
Using RegEx to automerge text files
I'm looking for a tool that will let me run a comparison on two files (A and B) and automatically copy changes from B to A if the text in B matches a regular expression. I've experimented with diff ...
1
vote
1
answer
84
views
want to convert OCR PDF to computer font
my pdf text is too blurry. so i want to convert it to computer font from scanned image.i already tried increassing quality by adobe/edit/preferences/page display.
Any OS is acceptable, any price. As ...
user71173
2
votes
1
answer
408
views
looking for python script to extract and reorganize tagged text
I am looking for a python script that will take a text file and extract and reorganize blocks of text in other files based on how those blocks are tagged. Before writing this myself (my coding is slow)...
- 23
4
votes
1
answer
87
views
Any software recommendations for getting the metadata of a PDF?
I have 10,000 PDF files in my drive and I need to capture the following metadata. I tried using wordstat but I'm unable to capture the following:
File Name
File Type
Asset Type
Asset Title
Product ...
- 51
1
vote
0
answers
79
views
Markdown formatter that converts inline links to reference-style links
I would like to find a CLI utility that replaces the inline links of a markdown file to reference-style links, a la this example.
On this website, I found a pandoc command that does something similar:
...
- 111
0
votes
0
answers
29
views
OCR software/application that transforms hand-written code to digitally-written code
What I am looking for is a software/application that takes a source code written by hand on a piece of paper and converts it to digital code in a clean, tidy, and orderly fashion. I do not want just ...
0
votes
0
answers
194
views
App or web-app to decode encoded strings (better than CyberChef's "magic")
I often have strings that are encoded with unknown encoding methods that I need to decode. Note that these strings are not encrypted; they are simply encoded.
I typically use CyberChef for these ...
- 7,034
2
votes
0
answers
376
views
Self-hosted OCR
I am looking for self-hosted OCR software.
Requirements:
Optical character recognition on images
Not just documents but also natural-scene-images
Linux Support
List item
Examples:
https://ocr.space/...
- 21
2
votes
1
answer
70
views
PDF editing software/note taking with indexing capability
I am a graduate student who is looking to upgrade my note taking capabilities. I am looking for a pdf editor (for windows 10) that can edit text (i.e highlight, underline, etc) but can also index ...
- 21
1
vote
1
answer
61
views
Find two text strings within N lines
I am looking for a gratis Windows program that can take a standard windows text file and search for occurrences of two user provided strings within N lines of each other, where N is user specified.
...
- 9,175