r/sysadmin • u/bozakman • 9d ago
PDF Redaction tools
Need help folk. Got a request from our compliance team (legal) for a software tool to redact PII content from an archive of PDFs. They want the tool to redact (automation a plus) and then be able to print the redacted versions. Really hoping someone can recommend a solid tool. Thanks.
20
u/thegoatcarlwheezer 9d ago
Adobe Acrobat Pro does this pretty well. Still need a manual review by a real person, but it speeds everything up.
1
7
u/External_Spirit_8880 9d ago
Whatever you use, check the source output of a few test redacted documents to make sure it actually DELETES the data, and doesn't paint a black rectangle over it or similar shenanigans.
6
u/z3dster 9d ago
whatever tool you end up with double check the output with both EXIFTool
and the Poppler tools to make sure the tools did what you wanted them to do. For example pdfimages will show if they left the underlying image there with just a black box as a second image over it
also always make sure the files are getting flattened to cut out extra info(you can always to be safe print the pdf to a pdf to be sure), for example a jpg with the gps info in the exif will survive being inserted into a pdf if you don't flatten the file
if you are on windows I suggest using WSL for poppler rather then run one of the native binaries
https://en.wikipedia.org/wiki/Poppler_(software)#poppler-utils
1
5
u/Webfiletool_Dev 9d ago
A few that hold up for compliance work, roughly by budget:
Adobe Acrobat Pro: Redact with search patterns (phone numbers, emails, ID formats) plus "Sanitize Document" to strip metadata, hidden layers and attachments. The Action Wizard can batch it over a folder, and most legal teams already trust the output.
Stirling-PDF (open source, self-hosted): has an auto-redact by text/regex and runs on your own server, so the archive never leaves your network. Good for a first pass.
Scripted: PyMuPDF's add_redact_annot + apply_redactions really removes the underlying text, and you can drive it with your own PII regexes and log every hit for legal to review.
Whatever you pick, two checks before calling it done: (1) run pdftotext or copy/paste on a redacted file and make sure the text is actually gone, not just covered by a black box; (2) scanned pages have no text layer, so pattern search finds nothing on them until you OCR them first. Automation finds the patterns; a human should still sign off on a sample.
3
3
3
u/jpotrz 9d ago
our law firm struggles with this very problem - on 1,000s of documents a week/month. We have yet to find a software that does it *perfectly*. If the documents are uniform, it can do it, but we get everything from standardized statements to handwritten notes on napkins (hyperbole). We have a few options of specialized AI options for our industry that we are looking into right now, but they are not cheap (but will save us money overall in labor - local and 3rd party)
2
u/facesofvader 9d ago
Check out iDox.ai
6
u/jpotrz 9d ago
we did last year. I can not tell you how much of a clusterfuck dealing with them was. They literally could not get anything done with them and then they kept billing us for MONTHS afterwards. Countless calls and emails before they stopped. Shitass company and the product didn't work well either.
2
3
u/smilaise AI Engineer 9d ago
I made KillerPDF if you are interested. https://killerpdf.net it's free
7
u/NH_shitbags 9d ago
PDFs, in general, are output ... so regenerate them all as compliant from the source?
4
u/geekywarrior 9d ago
I take it these are old reports that they no longer have the source for but still need to keep these records. And on top of that they need access to the non PII information in the reports for some non privledged staff
2
u/mrbradford 9d ago
If you don't want the cost of Adobe Acrobat Pro, we switched some users to Tungsten Power PDF. It's a good PDF software alternative with a good redaction feature.
2
2
u/Reasonable_Staff3902 5d ago
Have used Adobe Pro, Nitro PDF, and the free tool, PDF 24. Prefer Adobe, but could live with Nitro. Will take a bit of “getting used to” with PDF 24.
3
u/MadBoyEvo 9d ago
Take a look at https://officeimo.com I wrote it. Actively work on it and it has powershell, cli, gui etc. If you have specific use cases that are not clear or need improvments open issues.
3
u/brokenpipe Jack of All Trades 9d ago
The redact tool in Preview on the Mac works fantastically on PDFs.
1
u/Karahindiba32 8d ago
Try Doxudel. https://apps.microsoft.com/detail/9njsg1pnmllz It has the requirements you seek. You can calibrate the redaction too.
1
u/Either-Pressure2453 7d ago
I'm using Xodo. Does full redaction, so not just drawing black boxes on top of the text. Can handle a whole folder of PDFs at once too, which makes dealing with big archives a lot easier, won't detect random PII though without manual search terms.
1
u/AdvisorEquivalent824 7d ago edited 7d ago
Not sure of existing products for this. But I've had to do this. I made my own tool for it.
We needed to remove info from invoicing that we didn't want customers to see (nothing shady, just production notes)
I used Python and Fitz to do it. When orders came in, a PDF was generated by a ecommerce platform and was placed into a generic invoices folder on server.
I used Python for OS things like directory traversal and initial reading of names of invoices. Fitz to fully read and edit the PDF.
First I had it check the customer name (company), and create a folder for that name if it didn't already exist. It then added which boxes over the areas we wanted to redact (not sure if Fitz has updated but at the time it could only edit certain text fields. My workaround was instead just covering the text through X, Y usage). Then it would save these changes as a new copy of the PDF and dump it into the folder it previously created. I then added logging so that I had a record of everything it did including some light error handling.
I compiled this all into an executable.
Then I made a windows service that would run the executable once an hour.
Done.
End result: PDF is created by platform, and then automatically a copy of that PDF that is now redacted would be added into a folder named after the customer. Meaning we also now had a nice separation of all invoices by customer which did not exist before - they were all just thrown into the same invoices folder and you would have to dig to find specific customer invoices.
Took me 2 hours to write, compile, schedule, and run.
You could also have it delete originals, but I liked to spot check it against originals.
If you're at all in to coding it's a fun quick project.
Edit: Actually, thinking back on it, I might have used PyMuPDF at the time. I remember one or the other wasn't fitting my use case but can't remember which. Either way, totally doable.
1
u/Mykola_Melnyk_ML 5d ago
Try pdf-redaction. com it has online, API, desktop apps and on-premise version with single account. Auto redaction with review.
1
u/Reedy_Whisper_45 5d ago
Print the document to paper.
Redact info using Magic Marker.
Scan the results to a new file.
Shred the original printouts (use a cross-cut shredder to be sure to REALLY mix it up.)
Profit!
For the young whippersnappers - Magic Marker was a chisel-tipped permanent marker that existed before Sharpies.
And Magic Markers ARE soft wares, so the fit the request.
1
1
u/a_nardecchia 5d ago
Disclosure I'm with pdfRest by Datalogics. pdfRest has a two-stage redact process, the first step generates a preview for review and then apply permanent redactions. This is useful in cases like yours where a team would like to inspect results before printing.
You can evaluate it with the Starter plan, and if you are looking for something even more automated pdfRest has a verified node integration with n8n that provides a visual workflow for teams that prefer not to write code.
Do your archives contain searchable PDFs, scans, or both, and does processing have to stay inside your infrastructure?
1
u/LegalCouselor 1d ago
I make one: Offline PDF Redactor (Microsoft Store). It deletes the text under each box rather than drawing over it, strips author/title/bookmarks/attachments, never overwrites the original, and runs fully offline, so nothing gets uploaded. Free handles short PDFs; Pro adds SSN/phone/email/address detection, OCR for scanned pages and batches. https://apps.microsoft.com/detail/9PBQVQ6Z6DCW
•
u/ramoh1 17h ago
This is a new tool that does this. I worked on this along with a few others for our clients, it runs completely locally in your browser. It's still in beta, let me know if you need more features. The engine won't catch everything by default but you can setup a centralized word library that's retained and shared for all users. https://maskline.ai/ I can send you some free memberships if you are interested in trying it with your team. DM me
1
u/facesofvader 9d ago
IDox.ai is the leader in this space. If the volumes are low, their tech is called Smart Redact in Foxit PDF editor plus.
-10
u/PacificTSP 9d ago
Can’t you just feed this into AI? Have Claude cowork ingest and spit out cleansed ones. Then delete the originals.
9
u/nohairday 9d ago
That's possibly the worst suggestion of all available options.
9
u/SirLoremIpsum 9d ago
"I need to redact sensitive information"
"Have you tried uploading all the data to an AI for the world to see?"
0
u/PacificTSP 9d ago
Claude enterprise with HIPAA compliance does not share or learn from your data once you’ve configured it. If it can hold healthcare data securely it can hold PII.
4
6
27
u/PipeOne8414 9d ago
You can’t trust automated tools for this
If it missis somthing or redacts to much it still need human interaction
Our DPO loves wasting time manually doing this
He asked and looked into systems that will auto it but it still comes down to a human to check it all