Questions tagged [text-processing]
The text-processing tag has no usage guidance.
134
questions
0
votes
0
answers
8
views
GUI for source code documenting system, that can resolve references to comments in dual pane window?
I often have this problem, coding in C or Python: I start writing an expression, and it starts with a simple line comment, so far so good; say:
// initiate sending to hardware:
hardware_send_init(&...
- 141
0
votes
0
answers
3
views
DBpedia-Spotlight like tools for Chinese text?
I found a great tool DBpedia Spotlight to extract entities from text, but it seems that the spotter does not support Chinese. I wonder if there are some alternative open source repos which support ...
- 141
1
vote
1
answer
13
views
an AI text completer similar to tabnine
I am looking for an AI text completion extension for the browser that would display the next sentence like TabNine.
- 35
1
vote
1
answer
35
views
App to copy text from youtube video and paste into a terminal
On a linux machine, I watch many youtube videos associated with programming/coding. I would like to try out the code that is being presented in the youtube video. A useful app for me would be to be ...
- 171
1
vote
1
answer
12
views
Find duplicated or similar sentences from text in English
I would like a tool that takes input text and returns which sentences are duplicates and very similar (e.g., by informational distance as in Levenshtein distance). For example, if two sentences ...
0
votes
2
answers
42
views
Transform text into gibberish while maintains the "look" of the original text
I have some text. I want to generate gibberish instead of this text, but I want the gibberish to look the same, in the sense of being sequence of words of more-or-less the same lengths as the original ...
- 3,002
0
votes
0
answers
9
views
Tool or library to structure ingredient lists with relations
I am looking for a library (e.g. for python) or tool (e.g. to be used from terminal) that is able to structure a text that describes a dish in such a way that the semantics are preserved.
I found NLTK ...
- 133
0
votes
0
answers
11
views
Transforming web pages for ebook reader
I use getpocket.com for sending interesting articles to my ebook reader. This is useful as articles may be lengthy and ebook readers are better for this than a mobile phone.
But not every article goes ...
- 217
0
votes
1
answer
10
views
R library for matching similar names
I'm trying to join datasets with names that partially match, ex. "John Smith" vs. "Jonathan Q. Smith". I'm familiar with the fuzzy joins package and am wondering if there are other ...
- 101
0
votes
3
answers
96
views
Software to find & count duplicate strings in a text file
I am seeking recommendations for a Windows tool to find and count duplicate lines in a text file containing 500,000-999,999 lines.
The tool can be a CLI or GUI.
If the duplicate lines are consecutive ...
0
votes
0
answers
11
views
Looking for templated text extraction tool
I had a tool on Windows that I don't remember the name of and wondering if someone could help.
It was a very basic Windows GUI. I used it once to convert a Cisco firewall configuration into chunks of ...
0
votes
0
answers
12
views
C pre-preprocessing to enable module namespaces and keyword arguments
I need to write some C programs, however in general I find reading code written in this language considerably difficult. This is due to, I think, 2 factors: no module namespaces and no keyword ...
0
votes
0
answers
14
views
Regular expression search for multiple files with summary for Regex groups
I have a lot of files to search (17000+). I would like to search the file content using a regular expression. Unlike all programs that I know until now, I don't want to get a list of files (there will ...
- 9,662
0
votes
0
answers
11
views
Text annotation - multi class paragraph tagging
I'm looking for a very simple text annotation tool which can:
Allow me to upload text documents.
Allow me to tag sections of the text at the paragraph level (I can also split the documents into ...
user75141
1
vote
1
answer
9
views
R packages for text mining - beginner level
I am looking for a simple to use R package that will allow me to:
Analysis a chunk of text data for frequency
Easily allow me to exclude common terms e.g. "and" "yes"
Allow for ...
- 13
1
vote
3
answers
265
views
Is there something that can automatically align the equals sign (=) characters in text files?
We need to align the = character in our terraform files against the longest variable name. Is there any tool that can do this automatically?
For example
thomas = "train"
harrypotter = "...
- 141
1
vote
0
answers
20
views
Windows CLI tool to remove a specified line from a section within an `ini` file
Please recommend a gratis Windows CLI tool that allows one to remove a specified line from a section within an ini file.
For example, let's say you have the following ini file:
[settings]
height=100
...
1
vote
0
answers
40
views
Word processing software or other text-based tool that can "find" text with complex formatting
Follow up to my question here, I'm looking for word processing software or other text-based tool that can "find" text with complex (ie. formats not applied to the entire string) formatting, ...
- 111
0
votes
1
answer
23
views
Text Cleaning Tool
The online text tools on this page does almost everything one may need to “clean” the text in various ways. But often I need to perform multiple of those cleanings (for example replace smart quotes ...
- 247
0
votes
0
answers
29
views
Free Windows text search and replace across multiple files and directories (binary, archives office and PDF too would be nice)
One text search & replace to rule them all
We currently have 27 questions tagged text-search, and none of them really satisfy my requirements.
So, let's try for the one all-encompassing text ...
0
votes
1
answer
24
views
Looking for software / tool to shuffle alphabets / characters in text file
Looking for software / tool to shuffle alphabets / characters in text file,
Requirements:
use 1 password to shuffle and de-shuffle
correct password will de-shuffle the text file into its original ...
- 1
0
votes
1
answer
17
views
Using RegEx to automerge text files
I'm looking for a tool that will let me run a comparison on two files (A and B) and automatically copy changes from B to A if the text in B matches a regular expression. I've experimented with diff ...
1
vote
1
answer
80
views
want to convert OCR PDF to computer font
my pdf text is too blurry. so i want to convert it to computer font from scanned image.i already tried increassing quality by adobe/edit/preferences/page display.
Any OS is acceptable, any price. As ...
user71173
2
votes
1
answer
99
views
looking for python script to extract and reorganize tagged text
I am looking for a python script that will take a text file and extract and reorganize blocks of text in other files based on how those blocks are tagged. Before writing this myself (my coding is slow)...
- 23
2
votes
1
answer
61
views
Any software recommendations for getting the metadata of a PDF?
I have 10,000 PDF files in my drive and I need to capture the following metadata. I tried using wordstat but I'm unable to capture the following:
File Name
File Type
Asset Type
Asset Title
Product ...
- 31
1
vote
0
answers
28
views
Markdown formatter that converts inline links to reference-style links
I would like to find a CLI utility that replaces the inline links of a markdown file to reference-style links, a la this example.
On this website, I found a pandoc command that does something similar:
...
0
votes
0
answers
26
views
OCR software/application that transforms hand-written code to digitally-written code
What I am looking for is a software/application that takes a source code written by hand on a piece of paper and converts it to digital code in a clean, tidy, and orderly fashion. I do not want just ...
0
votes
0
answers
82
views
App or web-app to decode encoded strings (better than CyberChef's "magic")
I often have strings that are encoded with unknown encoding methods that I need to decode. Note that these strings are not encrypted; they are simply encoded.
I typically use CyberChef for these ...
2
votes
0
answers
201
views
Self-hosted OCR
I am looking for self-hosted OCR software.
Requirements:
Optical character recognition on images
Not just documents but also natural-scene-images
Linux Support
List item
Examples:
https://ocr.space/...
- 21
1
vote
1
answer
44
views
Find two text strings within N lines
I am looking for a gratis Windows program that can take a standard windows text file and search for occurrences of two user provided strings within N lines of each other, where N is user specified.
...
2
votes
3
answers
107
views
Terminal-based text editor for Linux with few dependencies
I'm using an old(ish) SLES Linux machine on which there are some issues with vi which I won't go into. I want to use another text editor - but none is installed as part of the distribution, and I'm ...
- 3,002
1
vote
0
answers
32
views
Editing text documents before feeding database
I hope this is the correct section for my question.
I need to paste 30 text files (they all have the same format, like 30 characters for the first column, 15 for the second one, and so on) one under ...
- 111
1
vote
1
answer
22
views
Batch Find/Replace within text file with savable/editable replace lists/presets
I am looking for software for Windows that provides a lot of functionality for Find/Replace batch operations on text files in folders.
A key feature is the ability to create batch lists of find/...
- 11
1
vote
2
answers
118
views
Visual scripting alternatives but for text ( text node editor )?
I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
- 11
2
votes
1
answer
31
views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
- 21
1
vote
1
answer
20
views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
- 111
1
vote
1
answer
904
views
Doxygen for Protobuf files or similar tool with little modification to comment format?
I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
- 121
1
vote
1
answer
22
views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
- 11
1
vote
0
answers
185
views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
- 11
1
vote
0
answers
17
views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1
answer
26
views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
- 123
1
vote
1
answer
37
views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
- 269
1
vote
0
answers
20
views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
- 11
2
votes
2
answers
418
views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...
0
votes
0
answers
19
views
Formatting large amounts of differently structured ascii text snippets into a uniform format
we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html.
The text snippets can be plain ...
- 1
0
votes
1
answer
51
views
Text/macro expansion program
I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string".
E.g. -abc- expands to ...
user416
0
votes
1
answer
39
views
Software that can convert large amount of data to md5 hash
Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
- 1
1
vote
2
answers
145
views
Preprocessor for Windows, good for generating HTML files
I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
- 163
1
vote
2
answers
57
views
Text classification using Python
I am doing a text classification related task in Python using NLP and SkLearn.
I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
- 11
1
vote
1
answer
528
views
How can I delete non-english words from text file?
I want to delete all words, which are not English, from the text file.
I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
- 183