Questions tagged [text-processing]
The text-processing tag has no usage guidance.
120
questions
-1
votes
0answers
6 views
What's my metanym - subject and meta-subject discovery with a known taxonomy
I have been playing with lda2vec, Gensim and other great tools but so far have not been able to satisfy this story
As a user wanting to know the subjects in a PDF I found, I want words examined for ...
0
votes
0answers
6 views
Complex text detection using .net c#
I am looking for a recommendation for a package, library or tool that will allow me to do complex text detection in an image using .Net
The image will not be a plain text image, it will be a number ...
0
votes
0answers
12 views
File content comparison ignoring formatting and some punctuations
I want to test a tool that generates text files based on some X input (not relevant for this question).
In order to be able to automate some tests and save time, I would like to know if there is a ...
0
votes
0answers
16 views
Creating word list file Text to Bin and vice versa
I have found an absolutely brilliant anagram solver.
https://www.fourmilab.ch/anagram/#download
the problem I have is that the wordlist he uses produces way too many results with words that are not ...
0
votes
0answers
5 views
Lemmatization of non modern texts
I'm curious about your experiences with lemmatization tools for non modern texts. Specifically, I'm interested in lemmatization tools for 18th and 19th century Spanish, French, Portuguese, Italian, ...
1
vote
2answers
15 views
Visual scripting alternatives but for text ( text node editor )?
I want to create tech document for my friend, and want to provide some logic structure. Is there any Visual Scripting alternatives but for text editing? Something like visual pseudo-scritping. Where I ...
1
vote
0answers
7 views
Tool to script simple find & replace for a fixed set of text strings
On a Mac:
Every month I collect lists of around 300-500 company names in Japanese that I need to translate into English. I tried scripting this with Applescript in Textwrangler, but this is hard to ...
1
vote
1answer
12 views
module or software to preprocess simple variable substitution for JSON files?
I'm taking my vscode theme settings and I'm breaking it out into a full fledged theme.
Themes are in JSON format.
I would also like to create a more unified color scheme. Let's say I tell my theme ...
1
vote
1answer
36 views
Doxygen for Protobuf files or similar tool with little modification to comment format?
I have been given a challenge for my first week at work as a graduate and I am stumped already, The company I work for uses google protobuf files - Grpc and I know extremely little about protobuf - ...
0
votes
0answers
2 views
Tool to find duplicate repeated groups of lines in log files?
I want to use it to reduce (either graphically collapsing the blocks or replacing the duplicate lines with a reference) the amount of text I need to read when when analyzing boot system log file.
...
0
votes
0answers
8 views
Text interpreter
I'm helping a friend who needs assistance in automating part of his job, but not sure how to start.
He's working in a bidding department inside a construction company, and preparing the bidding ...
0
votes
0answers
13 views
Library that takes in text and generates a title for it?
Does there exist a library that takes a plain text article, essay, etc, and generates an appropriate/quasi-appropriate title for it? "Title" meaning: about 1 to 10 words that meaningfully reflect the ...
0
votes
0answers
7 views
Text based topic segmentation
I'm doing a university project. I need to find a good way to identify topics in a given text file, probably a log text file and divide it into smaller segments(Topically cohesive segments). I have ...
0
votes
0answers
14 views
Can I use Node.js for text analysis?
We have the transcript for millions of text files (range of a few terabytes). We want to make a statistic of what our users answered to a set of questions. We do not necessary look for natural ...
0
votes
1answer
10 views
File Data Processor
I have to process tons of text/html files. Im looking for a tool that helps me to create a graph with processing nodes in order to make transformations on this files. For instance:
- A node loads the ...
1
vote
0answers
22 views
Free API for handwritten OCR (Optical Character Recognition)
I wanted to know if there are any free APIs available for text recognition from a handwritten document. I looked in Google Vision API, Microsoft Cognitive API but all of the above are paid. So is it ...
1
vote
0answers
11 views
Utility to create word list from a document
I need a utility that would parse a document (.odt or .txt), creating a list of words used therein, preferably ignoring the most common words (a, the, of, etc.).
A bonus would be if it gave a count ...
1
vote
1answer
22 views
Library to answer the questions 'Are there any locations mentioned in a particular text? If so: which locations are mentioned?'
I need to answer those two questions:
Are there any locations (in the sense of place: "capital of France", "South of Spain", "London", "New Zealand", etc. ) mentioned in a particular text?
If so: ...
1
vote
1answer
35 views
Cheap or free convenient application for making subtitles?
I tried aegisub, but it was inconvenient: I can't control video playback with keyboard shortcuts and synchronization between subtitle sheet and video. It can be for any operating system (Windows, ...
0
votes
0answers
5 views
Automatic/semi-automatic construction of an ontology out of an encyclopedia
I have to build a knowledge base of the domain class of insurance (country specific -> Switzerland).
The expected result is the following:
An ontology with classes, subclasses, data properties etc ...
1
vote
0answers
7 views
Web-based Grep app
I am looking for an application I can host at my house on one of my servers that allows me to grep large datasets.
I have roughly 10-15 TB of txt files. I am currently using a GUI-based grep ...
0
votes
0answers
20 views
Software to find duplicate paragraphs or phrases in multiple microsoft word documents
Here is my condition:
I have many drafts microsoft word documents.
I want to make one microsoft word document.
Therefore,
I need to
find duplicate words or paragraphs
copy them into final document ...
1
vote
2answers
36 views
Software to search for duplicate lines within a text file
I have a text file containing 20K URL's. Within the file, 1-2 blank lines are present between many of the URL's. I need to find all duplicate URL's within the file and remove them.
The order of ...
0
votes
0answers
14 views
Formatting large amounts of differently structured ascii text snippets into a uniform format
we need a software recommendation for the task of formatting large amounts of differently structured ascii text snippets into a uniform format that looks good in html.
The text snippets can be plain ...
0
votes
0answers
30 views
Are the application for transcribing audio into subtitles?
There is such application as gTranscribe that allows you to play audio and type text into the text area below and it puts time stamp automatically at the and of each line. Are there something similar, ...
0
votes
0answers
7 views
I am looking for some existing library or code that can convert my Unicode hindi text to KrutiDev Devanagri?
Can someone recommend any code or existing library in any python? If not python any language will be fine.
0
votes
0answers
11 views
Library or framework for flat file handling?
I'd started a new job recently and am in the process of learning about / taking ownership over some of the existing systems that we've got in place. Within the past few days I'd discovered that one ...
0
votes
1answer
16 views
Text/macro expansion program
I'm looking for a simple Windows program that lets me define some macro texts that are automatically expanded when I type. Just simply "replace this string with this string".
E.g. -abc- expands to ...
0
votes
0answers
14 views
OCR for LCD Display (must deal light and shadows zones)
I see that most people use OCR for documents and license plates.
I need to solve a problem using OCR to recognize characters (numbers) in a LCD display and transform into text (after that put that ...
0
votes
1answer
33 views
Software that can convert large amount of data to md5 hash
Currently I have a 2gb database with approximately 100 million lines and I want to convert every single line to md5 hash is there a program that can do it relatively quick.
1
vote
2answers
61 views
Preprocessor for Windows, good for generating HTML files
I need a template engine (preprocessor) for Windows that allows me to define my own (very simple) language. I need it for generating html files. It should be able to make macro substitutions but also ...
0
votes
0answers
3 views
software to detect repeated text phrases (full sentence followed by identical phrase from that sentence)
Stackexchangers,
I have a couple of hundred XML texts, which contain textual repetitions of the following type:
In cases where exceptional balance of payments difficulties exist, and then for a ...
0
votes
0answers
9 views
Extracting tabular data from HTML pages
I need to examine an HTML page with a listing of multiple items (people, media files etc.) - having some elements of data per item: Links, numbers, strings etc. - and placing the results in a plain, ...
1
vote
0answers
13 views
Text classification using Python
I am doing a text classification related task in Python using NLP and SkLearn.
I need to remove random words from my text. I know I can remove stop words and punctuation using nlp. But what I am ...
0
votes
0answers
11 views
(Semantic) Highlighting of any text for improved speed reading
I'm looking for an application that is able to process the (semantic) content of a text and provides an easier-to-read output. I'm imagining an app that takes Text (e.g., in PDF format) and provides a ...
1
vote
1answer
36 views
How can I delete non-english words from text file?
I want to delete all words, which are not English, from the text file.
I have done some research about the topic on google and have found a python tool which is named pyenchant for this task. I have ...
0
votes
1answer
20 views
XML libraries for java
Please succintly summarize the licensing and vendor implementations available for:
XQuery
JAXP
XQJ
specific to Java and where the libraries can be found for build files.
4
votes
5answers
66 views
Copy & paste texts omitting leading/trailing white spaces
Looking for utility/macro/plugin to paste texts from clipboard omitting leading/trailing white spaces.
Couldn't find this feature in macros in PhraseExpress or utilities like PureText.
Thanks.
0
votes
1answer
26 views
WWW: Many pages to one?
We have a documentation/help system in the form of 'a lot of www pages (one-topic-per-page)'.
Is there any ready-to-go software/script able to change that docs to 'all-in-one-page' format?
2
votes
1answer
31 views
Utility to recursively process text file templates and fill in placeholders
I search for a tool that is / can:
gratis
free from dependencies (no scripting language interpreter needed, ...)
preferably a single binary
run on Linux, optionally Windows
traverse a (sub)directory ...
1
vote
0answers
19 views
Looking for text list merge program
I'm looking for a program that can combine several lists.
Must be Windows supported, completely free or freemium, has an interface and unicode supported. It should be able to add prefix, suffix and ...
0
votes
1answer
28 views
Headline Capitalization
Background
Developers write JIRA tickets; developers do not style the ticket items consistently. We'd like to present the ticket summaries to clients, but with a consistent format.
Problem
We're ...
1
vote
1answer
93 views
Language detection at shell command
I need to detect the language of a huge amount of files, and I was wondering if there is some tool which I could use in a way similar to this, in linux command shell:
langdetector filetodetect > ...
2
votes
1answer
37 views
Getting marked up difference of two big normal texts (not source code)
How to get difference text of two ebooks converted to plain text?
They are both the same book but different editions, so much of text is exactly the same to within hyphenation and punctuation changes.
...
2
votes
0answers
78 views
Software to convert very, very large html file to markdown
I have a single 1.3gb html file that contains the entirety of the Encyclopedia Britannica. I want to convert it to markdown in a way that preserves subheadings, tables, and UTF-8 special characters.
...
2
votes
0answers
9 views
Textual authorship testing options?
There's a pretty remarkable piece of software called jstylo from Drexel University, but it appears to have been untouched for a couple of years.
Are there any comparable options to this that analyze ...
0
votes
1answer
142 views
Convert JSPWiki to XWiki
Background
Looking to convert a document written in JSPWiki format to a file written in any format supported by pandoc.
Requirements
Preferably CommonMark or basic HTML output.
No attachments.
No ...
2
votes
1answer
59 views
Is there a very simple version control tool that only uses a diff-based change log for a text file?
Parsing the change log and reconstructing an older version automatically is not a requirement. The only objective is to make everything I ever wrote and saved and potentially deleted searchable and ...
0
votes
0answers
42 views
Open source tool to extract text from developer file types
I would like to parse the text content from these developer file types and index them and make them available for my lucene search engine for search.
I would like to parse the text content from these ...
1
vote
0answers
50 views
Open source tool to do OCR
I would like to parse the text content (OCR) from these image file types and index them and make them available for my lucene search engine for search.
.ai .bmp .gif .jpeg .jpg .png .psd .ttf
Can ...
