Questions tagged [text-processing]
The text-processing tag has no usage guidance.
115
questions
1
vote
1answer
16 views
Find two text strings within N lines
I am looking for a gratis Windows program that can take a standard windows text file and search for occurrences of two user provided strings within N lines of each other, where N is user specified.
...
0
votes
0answers
6 views
Text (numerical) recognition software for amateur laboratory use
I'm looking for a piece of software (or library in python, c++...) that could in general automatically recognize numbers displayed on multimeters' screens in lab setting. Given video file I want to ...
1
vote
3answers
48 views
Terminal-based text editor for Linux with few dependencies
I'm using an old(ish) SLES Linux machine on which there are some issues with vi which I won't go into. I want to use another text editor - but none is installed as part of the distribution, and I'm ...
1
vote
0answers
25 views
Editing text documents before feeding database
I hope this is the correct section for my question.
I need to paste 30 text files (they all have the same format, like 30 characters for the first column, 15 for the second one, and so on) one under ...
1
vote
1answer
16 views
Batch Find/Replace within text file with savable/editable replace lists/presets
I am looking for software for Windows that provides a lot of functionality for Find/Replace batch operations on text files in folders.
A key feature is the ability to create batch lists of find/...
0
votes
0answers
13 views
Is there an online tool that cuts off subdomains and leaves only domains?
Is there a tool to which I can give a list of path names (google.com, test.something.co.uk, bla.anothersomething.club, etc.) and it will give me a list of root domains (in this case google.com, ...
0
votes
0answers
3 views
Converting a TextBase Project RoadMap to Graphics
Please have a look at https://yuml.me/diagram/scruffy/class/draw. This site automatically draw UML graphics from text. This release you form using any graphical tools.
Now please have a look at ...
0
votes
0answers
20 views
200 million rows and 60GB file processing
There is one file.
The file has 200 million rows and is 60 GB in size.
I want to paging the rows of that file.
ascii text file sample payload
aaa,bbb,ccc,ddd,ggg
aaa,bbb,ccc,ddd,ggg
aaa,bbb,ccc,...
0
votes
0answers
7 views
Complex text detection using .net c#
I am looking for a recommendation for a package, library or tool that will allow me to do complex text detection in an image using .Net
The image will not be a plain text image, it will be a number ...
0
votes
0answers
12 views
File content comparison ignoring formatting and some punctuations
I want to test a tool that generates text files based on some X input (not relevant for this question).
In order to be able to automate some tests and save time, I would like to know if there is a ...
0
votes
0answers
17 views
Creating word list file Text to Bin and vice versa
I have found an absolutely brilliant anagram solver.
https://www.fourmilab.ch/anagram/#download
the problem I have is that the wordlist he uses produces way too many results with words that are not ...
0
votes
0answers
8 views
Lemmatization of non modern texts
I'm curious about your experiences with lemmatization tools for non modern texts. Specifically, I'm interested in lemmatization tools for 18th and 19th century Spanish, French, Portuguese, Italian, ...
1
vote
2answers
31 views
Visual scripting alternatives but for text ( text node editor )?
I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
2
votes
1answer
21 views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
1
vote
1answer
12 views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
1
vote
1answer
237 views
Doxygen for Protobuf files or similar tool with little modification to comment format?
I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
0
votes
0answers
15 views
Can I use Node.js for text analysis?
We have the transcript for millions of text files (range of a few terabytes). We want to make a statistic of what our users answered to a set of questions. We do not necessary look for natural ...
1
vote
1answer
20 views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
1
vote
0answers
131 views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
1
vote
0answers
11 views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1answer
24 views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
1
vote
1answer
36 views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
1
vote
0answers
11 views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
2
votes
2answers
55 views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...
0
votes
0answers
14 views
Formatting large amounts of differently structured ascii text snippets into a uniform format
we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html.
The text snippets can be plain ...
0
votes
0answers
38 views
Are the application for transcribing audio into subtitles?
There is such application as gTranscribe that allows you to play audio and type text into the text area below and it puts time stamp automatically at the and of each line. Are there something similar, ...
0
votes
1answer
25 views
Text/macro expansion program
I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string".
E.g. -abc- expands to ...
0
votes
1answer
35 views
Software that can convert large amount of data to md5 hash
Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
1
vote
2answers
85 views
Preprocessor for Windows, good for generating HTML files
I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
1
vote
1answer
22 views
Text classification using Python
I am doing a text classification related task in Python using NLP and SkLearn.
I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
1
vote
1answer
217 views
How can I delete non-english words from text file?
I want to delete all words, which are not English, from the text file.
I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
0
votes
1answer
28 views
XML libraries for java
Please succintly summarize the licensing and vendor implementations available for:
XQuery
JAXP
XQJ
specific to Java and where the libraries can be found for build files.
4
votes
5answers
80 views
Copy & paste texts omitting leading/trailing white spaces
Looking for utility/macro/plugin to paste texts from clipboard omitting leading/trailing white spaces.
Couldn't find this feature in macros in PhraseExpress or utilities like PureText.
Thanks.
0
votes
1answer
27 views
WWW: Many pages to one?
We have a documentation/help system in the form of 'a lot of www pages (one-topic-per-page)'.
Is there any ready-to-go software/script able to change that docs to 'all-in-one-page' format?
2
votes
1answer
34 views
Utility to recursively process text file templates and fill in placeholders
I search for a tool that is / can:
gratis
free from dependencies (no scripting language interpreter needed, ...)
preferably a single binary
run on Linux, optionally Windows
traverse a (sub)directory ...
1
vote
0answers
19 views
Looking for text list merge program
I'm looking for a program that can combine several lists.
Must be Windows supported, completely free or freemium, has an interface and unicode supported. It should be able to add prefix, suffix and ...
0
votes
1answer
29 views
Headline Capitalization
Background
Developers write JIRA tickets; developers do not style the ticket items consistently. We'd like to present the ticket summaries to clients, but with a consistent format.
Problem
We're ...
1
vote
1answer
233 views
Language detection at shell command
I need to detect the language of a huge amount of files, and I was wondering if there is some tool which I could use in a way similar to this, in linux command shell:
langdetector filetodetect > ...
2
votes
1answer
42 views
Get difference of two regular literature texts (not source code), with markup on changes
How to get difference text of two ebooks converted to plain text?
They are both the same book but different editions, so much of text is exactly the same to within hyphenation and punctuation changes.
...
2
votes
0answers
80 views
Software to convert very, very large html file to markdown
I have a single 1.3gb html file that contains the entirety of the Encyclopedia Britannica. I want to convert it to markdown in a way that preserves subheadings, tables, and UTF-8 special characters.
...
2
votes
0answers
9 views
Textual authorship testing options?
There's a pretty remarkable piece of software called jstylo from Drexel University, but it appears to have been untouched for a couple of years.
Are there any comparable options to this that analyze ...
0
votes
1answer
210 views
Convert JSPWiki to XWiki
Background
Looking to convert a document written in JSPWiki format to a file written in any format supported by pandoc.
Requirements
Preferably CommonMark or basic HTML output.
No attachments.
No ...
2
votes
1answer
60 views
Is there a very simple version control tool that only uses a diff-based change log for a text file?
Parsing the change log and reconstructing an older version automatically is not a requirement. The only objective is to make everything I ever wrote and saved and potentially deleted searchable and ...
0
votes
0answers
52 views
Open source tool to extract text from developer file types
I would like to parse the text content from these developer file types and index them and make them available for my lucene search engine for search.
I would like to parse the text content from these ...
1
vote
0answers
53 views
Open source tool to do OCR
I would like to parse the text content (OCR) from these image file types and index them and make them available for my lucene search engine for search.
.ai .bmp .gif .jpeg .jpg .png .psd .ttf
Can ...
2
votes
1answer
314 views
What is the best open source tool to parse text content from files to make it available for search?
I would like to parse text content from any type of file to make it available for search. Say the file may be .txt, .docx - document type files or it may be an image, audio or video file.
I could ...
2
votes
0answers
72 views
Text file (log) viewer GUI with interactive coloring of multiple search patterns?
I am viewing text files (logs) with a massive ammount of data. I view them in a typical text editor like Scite or Geany, where the default view formatting is black letters on white background. What ...
0
votes
1answer
35 views
Program that sorts lines in a text file by number of occurences
I have a large text file with a lot of lines of terms. Some lines repeat themselves. I want a program that gives me the lines that appear most often in the entire document.
2
votes
2answers
44 views
Semantic Tagging and analysis or extraction of text (Windows/OS X)
I'm looking for a software to add semantic tags to a long, structured text, with the ability to search for, extract, maybe analyse these tags.
Specifically, the text is structured into chapters and ...
1
vote
0answers
19 views
Level, and center, scanned text documents
Looking for a program that can level and center the text in scanned pages. Scans are to .pdfs with occasional pictures but mostly text.
My example is the scanning of a paper that was not aligned when ...
