Questions tagged [text-processing]
The text-processing tag has no usage guidance.
116
questions
1
vote
0answers
7 views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
1
vote
1answer
10 views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
1
vote
1answer
20 views
Doxygen for Protobuff files or similar tool with little modification to comment format?
Hello i have been given a challenge for my first week at work as a graduate and i am stumped already, The company i work for uses google protobuff files - Grpc and i know extremely little about ...
0
votes
0answers
2 views
Tool to find duplicate repeated groups of lines in log files?
I want to use it to reduce (either graphically collapsing the blocks or replacing the duplicate lines with a reference) the amount of text I need to read when when analyzing boot system log file.
...
0
votes
0answers
8 views
Text interpreter
I'm helping a friend who needs assistance in automating part of his job, but not sure how to start.
He's working in a bidding department inside a construction company, and preparing the bidding ...
0
votes
0answers
13 views
Library that takes in text and generates a title for it?
Does there exist a library that takes a plain text article, essay, etc, and generates an appropriate/quasi-appropriate title for it? "Title" meaning: about 1 to 10 words that meaningfully reflect the ...
0
votes
0answers
5 views
Text based topic segmentation
I'm doing a university project. I need to find a good way to identify topics in a given text file, probably a log text file and divide it into smaller segments(Topically cohesive segments). I have ...
0
votes
0answers
14 views
Can I use Node.js for text analysis?
We have the transcript for millions of text files (range of a few terabytes). We want to make a statistic of what our users answered to a set of questions. We do not necessary look for natural ...
0
votes
1answer
10 views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
1
vote
0answers
11 views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
1
vote
0answers
10 views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1answer
22 views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
1
vote
1answer
35 views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
0
votes
0answers
4 views
Automatic/semi-automatic construction of an ontology out of an encyclopedia
I have to build a knowledge base of the domain class of insurance (country specific -> Switzerland).
The expected result is the following:
An ontology with classes, subclasses, data properties etc ...
1
vote
0answers
7 views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
0
votes
0answers
7 views
Software to find duplicate paragraphs or phrases in multiple microsoft word documents
Here is my condition:
I have many drafts microsoft word documents.
I want to make one microsoft word document.
Therefore,
I need to
find duplicate words or paragraphs
copy them into final document ...
1
vote
2answers
35 views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...
0
votes
0answers
12 views
Formatting large amounts of differently structured ascii text snippets into a uniform format
we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html.
The text snippets can be plain ...
0
votes
0answers
30 views
Are the application for transcribing audio into subtitles?
There is such application as gTranscribe that allows you to play audio and type text into the text area below and it puts time stamp automatically at the and of each line. Are there something similar, ...
0
votes
0answers
7 views
I am looking for some existing library or code that can convert my Unicode hindi text to KrutiDev Devanagri?
Can someone recommend any code or existing library in any python? If not python any language will be fine.
0
votes
0answers
11 views
Library or framework for flat file handling?
I'd started a new job recently and am in the process of learning about / taking ownership over some of the existing systems that we've got in place. Within the past few days I'd discovered that one ...
0
votes
1answer
15 views
Text/macro expansion program
I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string".
E.g. -abc- expands to ...
0
votes
0answers
11 views
OCR for LCD Display (must deal light and shadows zones)
I see that most people use OCR for documents and license plates.
I need to solve a problem using OCR to recognize characters (numbers) in a LCD display and transform into text (after that put that ...
0
votes
1answer
33 views
Software that can convert large amount of data to md5 hash
Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
1
vote
2answers
59 views
Preprocessor for Windows, good for generating HTML files
I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
0
votes
0answers
3 views
software to detect repeated text phrases (full sentence followed by identical phrase from that sentence)
Stackexchangers,
I have a couple of hundred XML texts, which contain textual repetitions of the following type:
In cases where exceptional balance of payments difficulties exist, and then for a ...
0
votes
0answers
9 views
Extracting tabular data from HTML pages
I need to examine an HTML page with a listing of multiple items (people, media files etc.) - having some elements of data per item: Links, numbers, strings etc. - and placing the results in a plain, ...
1
vote
0answers
13 views
Text classification using Python
I am doing a text classification related task in Python using NLP and SkLearn.
I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
0
votes
0answers
11 views
(Semantic) Highlighting of any text for improved speed reading
I'm looking for an application that is able to process the (semantic) content of a text and provides an easier-to-read output. I'm imagining an app that takes Text (e.g., in PDF format) and provides a ...
1
vote
1answer
30 views
How can I delete non-english words from text file?
I want to delete all words, which are not English, from the text file.
I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
0
votes
1answer
18 views
XML libraries for java
Please succintly summarize the licensing and vendor implementations available for:
XQuery
JAXP
XQJ
specific to Java and where the libraries can be found for build files.
4
votes
5answers
63 views
Copy & paste texts omitting leading/trailing white spaces
Looking for utility/macro/plugin to paste texts from clipboard omitting leading/trailing white spaces.
Couldn't find this feature in macros in PhraseExpress or utilities like PureText.
Thanks.
0
votes
1answer
26 views
WWW: Many pages to one?
We have a documentation/help system in the form of 'a lot of www pages (one-topic-per-page)'.
Is there any ready-to-go software/script able to change that docs to 'all-in-one-page' format?
0
votes
0answers
16 views
Real-Time Personally Identifiable Information (PII) Detection
I have a project that involves free text user input (strings of less than 80 characters) and I need to detect PII within that string. This all needs to happen in real-time as we need to send a ...
2
votes
1answer
31 views
Utility to recursively process text file templates and fill in placeholders
I search for a tool that is / can:
gratis
free from dependencies (no scripting language interpreter needed, ...)
preferably a single binary
run on Linux, optionally Windows
traverse a (sub)directory ...
1
vote
0answers
19 views
Looking for text list merge program
I'm looking for a program that can combine several lists.
Must be Windows supported, completely free or freemium, has an interface and unicode supported. It should be able to add prefix, suffix and ...
0
votes
0answers
11 views
Utility to create timeline from events
Suppose I have a table (e.g. in a CSV file) of events with start and end times, and names. I want to generate a timeline, which is made up of either intervals in which there's no change (i.e. between ...
0
votes
1answer
27 views
Headline Capitalization
Background
Developers write JIRA tickets; developers do not style the ticket items consistently. We'd like to present the ticket summaries to clients, but with a consistent format.
Problem
We're ...
1
vote
1answer
78 views
Language detection at shell command
I need to detect the language of a huge amount of files, and I was wondering if there is some tool which I could use in a way similar to this, in linux command shell:
langdetector filetodetect > ...
2
votes
1answer
37 views
Getting marked up difference of two big normal texts (not source code)
How to get difference text of two ebooks converted to plain text?
They are both the same book but different editions, so much of text is exactly the same to within hyphenation and punctuation changes.
...
2
votes
0answers
77 views
Software to convert very, very large html file to markdown
I have a single 1.3gb html file that contains the entirety of the Encyclopedia Britannica. I want to convert it to markdown in a way that preserves subheadings, tables, and UTF-8 special characters.
...
2
votes
0answers
9 views
Textual authorship testing options?
There's a pretty remarkable piece of software called jstylo from Drexel University, but it appears to have been untouched for a couple of years.
Are there any comparable options to this that analyze ...
0
votes
1answer
122 views
Convert JSPWiki to XWiki
Background
Looking to convert a document written in JSPWiki format to a file written in any format supported by pandoc.
Requirements
Preferably CommonMark or basic HTML output.
No attachments.
No ...
2
votes
1answer
59 views
Is there a very simple version control tool that only uses a diff-based change log for a text file?
Parsing the change log and reconstructing an older version automatically is not a requirement. The only objective is to make everything I ever wrote and saved and potentially deleted searchable and ...
0
votes
0answers
42 views
Open source tool to extract text from developer file types
I would like to parse the text content from these developer file types and index them and make them available for my lucene search engine for search.
I would like to parse the text content from these ...
1
vote
0answers
48 views
Open source tool to do OCR
I would like to parse the text content (OCR) from these image file types and index them and make them available for my lucene search engine for search.
.ai .bmp .gif .jpeg .jpg .png .psd .ttf
Can ...
2
votes
1answer
114 views
What is the best open source tool to parse text content from files to make it available for search?
I would like to parse text content from any type of file to make it available for search. Say the file may be .txt, .docx - document type files or it may be an image, audio or video file.
I could ...
2
votes
0answers
49 views
Text file (log) viewer GUI with interactive coloring of multiple search patterns?
I am viewing text files (logs) with a massive ammount of data. I view them in a typical text editor like Scite or Geany, where the default view formatting is black letters on white background. What ...
0
votes
1answer
35 views
Program that sorts lines in a text file by number of occurences
I have a large text file with a lot of lines of terms. Some lines repeat themselves. I want a program that gives me the lines that appear most often in the entire document.
2
votes
2answers
43 views
Semantic Tagging and analysis or extraction of text (Windows/OS X)
I'm looking for a software to add semantic tags to a long, structured text, with the ability to search for, extract, maybe analyse these tags.
Specifically, the text is structured into chapters and ...
