r/DatabaseHelp • • Dec 08 '25

What’s the best way to catalog and search large collections of datasets in a database?

22 Upvotes

I’m working on a system that needs to catalog a huge number of datasets different subjects, different formats, and different licensing requirements. The datasets themselves won’t live inside the database, but the metadata needs to be stored in a way that’s fast, scalable, and easy to search.

I’m trying to figure out the cleanest database approach for this.
Some of the things I need to track include:

  • Dataset title, description, tags

  • File format, file location, size

  • License type (some proprietary, some open, some restricted)

  • Dataset category or domain

  • Update/version history

  • Contributor/uploader info

I’m unsure whether a fully normalized relational model is ideal, or if something more flexible like a document database for metadata would handle variety better.

For anyone who has built dataset catalogs, research libraries, or similar metadata heavy systems:
What database structure worked best for you, especially when dealing with mixed file types and licensing rules?

I’d appreciate any guidance or examples of schemas that scale well.


r/DatabaseHelp • • Oct 17 '25

Which database app would suit my needs?

19 Upvotes

Hi all; I’m currently running a game of Dungeons and Dragons, and the character list is getting a bit out of hand! I’d like something to keep on top of it all, but I haven’t worked with databases much since school. Each entry would need about a dozen different parameters, for example their name, personality traits, where they live/work, etc. Ideally I’d love to be able to enter artwork for each as well, so I’m not trawling through loads of different things to find it. I’d also like to be able to search each parameter, for example a specific location, and be able to see all the characters that could be found there. I’m working on iPad, and ideally looking for something low cost/free; I don’t feel like I need tons of features beyond what I’ve described, and it is just for personal use. Any suggestions or tips would be greatly appreciated! Thank you!


r/DatabaseHelp • • Jan 03 '25

Replacement for Borland Paradox?

18 Upvotes

Many here may be too young to even know what Borland Paradox. https://en.wikipedia.org/wiki/Paradox_(database)There was a DOS version created by Ansa Software in the 80's, purchased by Borland in 87 and refreshed, then in about 92 or 93 Borland created a windows version. Borland. Paradox, dBase, Foxpro, Clipper, and MSAccess all pretty much competed for the same market.

We started using Paradox for DOS in about 91 for keeping track of our cattle records. We switched to Paradox for Windows after Windows 3.11 came out and networking became much easier to do on Windows.

Paradox in my opinion was light years ahead of their competition, it allowed us to create a relational database, custom queries, forms, and reports. Could even compile an app and distribute it with Paradox Runtime. It had a robust ObjectPAL language that was fairly easy to learn and was powerful enough to do what we wanted.

Corel acquired Paradox in 1997 and that is where it went to die. They haven't released a version with anything but rudimentary bug fixes since then. It has never been rewritten from the 32-bit code base.

We are still using it because it does what we need. I envision a day when it won't work any more. Support is non-existant. The last 3rd party supporting Paradox apps (that I am aware of) charges more than our small company can justify. $450 setup+$150/mo+$125-$195/hr.

Over the years, I have been on the lookout for a replacement for our Cattle Record Database, but am too old flat out learn .NET or similar and hand code something from scratch.

About 20 years ago, I purchased Borland Delphi (Now Embarkadero https://www.embarcadero.com/products/Delphi) and tried to do a port. I got about half way there, but got bogged down in the ObjectPascal and was never able to get a good grasp of it. I still have some compiled exe's that are view only of the database that still work.

8 or 10 years ago I looked into Alpha4/Alpha Anywhere https://www.alphasoftware.com/ and actually built out a basic database. Maybe I need to take another look at that.

What we are using works well for all our needs now, but is a little clunky and I fear won't last for the long-haul.

Not sure how robust Access is right now, but MS has gone to a subscription plan and I really don't like that idea. I think to do what we can do in Paradox with the built in ObjectPal, I would have to learn Visual Basic or .NET.

I just through I would post here to see if anybody could recommend something I should look into.

Thanks
-Kirk


r/DatabaseHelp • • Dec 29 '25

Small runtime anomalies we tend to ignore

11 Upvotes

I’ve noticed teams often ignore small anomalies because nothing is broken. Looking back, those small things were early indicators. What subtle signals turned out to matter more than you expected?


r/DatabaseHelp • • Nov 12 '25

So, if I want to hire a db specialist?

10 Upvotes

Hello everyone,

Please accept my apologies if I am posting in the wrong place.

I was wondering what would be the proper way to go about hiring someone to put in a professional format my vision about a database "layout"?

I want to define customers (Ltd) and contact relationships, products interaction and supplier hierarchy.

I am completely outside of my skills. But I know what I want. I have a vision. Would be great if the right person would ask the right questions to complement my vision.

Would this be a good place to start asking for a specialist?

Thank you for your time.


r/DatabaseHelp • • Oct 02 '25

Help with design pattern, matching parameters

10 Upvotes

Running a postgres DB, data is ingested from API with python scripts from different APIs. I want to put it in a normalized way according to data needs.

The problem i have is that each entity have a parameter on a specific treatment. However, each API has its own naming schema for the treatment and sometimes they provide a treatment misspelled. I would like to normalize the entity with one treatment X1, but treatment X1 can have 5 different treatment names so without normalization theres X1 - X5 treatments. I was thinking i could deal with this by making a lookup table which lists every type of treatment and has a column with the normalized treatment name which i could specify. Basically a lookup table.

Is this something i shoulddeal with in the DB or in the data cleanup step/ingestion? In python i could load a json with a massive dict containing the lookups. Or is it more feasible to create a table in the DB and let it do its thing on insertion?

Any input is welcome.


r/DatabaseHelp • • Aug 12 '25

Contact Database Suggestions

9 Upvotes

Hello! I've been tasked with building/finding a contact database for work that's relatively simple, but most of what I'm finding come with things we won't need.

I work in a think tank and we reach out to people to invite them to events we are hosting or to collaborate with on publishing. We primarily want to use it for:

  • Shared contact database. There are about 15 people in my department and we want to consolidate all our contacts into one place where we can all access (cloud-based, maybe integration with Outlook).

  • Tagging contacts with information like job type, area of interest, etc.

  • Easy to filter and search for contacts. For example, if I want to view all our contacts that have an interest in economics I could type that in and the tags would filter that.

I think the closest thing we'd need is a CRM but all the ones I've looked at include automated emails, task management, or other complex features that we will not use. Visual DB looks like it could work but I need to provide a list of different kinds to my manager.

Any insight would be much appreciated!! Also if this is not the right sub, please let me know :)


r/DatabaseHelp • • Jul 17 '25

Compare sql column to JSON file

9 Upvotes

I have a table column that contains the parsed data of a JSON file. I would like to compare the parsed data to the JSON file. What’s the easiest way to compare the two. The goal is to independently verify that the source matches the destination. I’m new to JSON.


r/DatabaseHelp • • May 11 '22

Non-tech person looking for a simple/free database?

8 Upvotes

Please let me know if I'm in the wrong place, thanks!

What I want to do: I'm moving to Chicago soon. There are so many things I want to do! I am hoping to find a way to keep these ideas organized by neighborhood, type of activity (museum, restaurant, etc.), cost - all that good stuff. But without having to manually copy/paste info into multiple tabs, and with the ability to update all related entries at once.

For example: I want to visit the Museum of Science & Industry. I would want to easily be able to pull up its information when viewing things to do in South Shore, or museums to visit, or places open on Weds, or things to do that cost less than $25. If the price goes up, I want to be able to update that only in one place. And ideally, I want to be able to access this info on my phone/on the go.

Is there a better idea than a Google Sheet? Or should I just accept the fact that I will be using Sort and/or Ctrl+F forever?

Thanks again!


r/DatabaseHelp • • Nov 11 '25

Databases Introduction For Complete Beginner ?

7 Upvotes

I have a friend who is curious about databases, SQL, and other data tools. What are some good, introductory videos, websites, tutorials etc, for a complete "noob" ? I can help explain and answer questions, but he could use something to watch/read on his own time.

Thoughts ?


r/DatabaseHelp • • Nov 08 '25

Help with designing vehicle supply list database

7 Upvotes

I work for an ambulance company. We deploy 15 ambulances with 6 variations of interior/exterior cabinet layouts. We carry the same supplies in every ambulance, but they may be located in slightly different places due to the differences in layout. My goal is to build a robust database that would allow me to generate supply lists by ambulance layout. Ideally, this structure would prevent me from needing to update multiple supply lists when there are changes to supplies (i.e. what we carry, how many we carry). A complicating factor is that each cabinet may have one or more shelves, those shelves may have bins or bags, and bags may have various pockets and containers inside the bag.

Here is what I've come up with. Does this make sense or is there a better way to do this? Thanks in advance from a database novice.

Supplies

supply_id [pk]

name

unit (unit of measure)

Ambulances

ambulance_id [pk]

layout_id [fk]

Layouts

layout_id [pk]

Containers

container_id [pk]

parent_container_id [fk] (defines permanent nesting like pockets)

container_type (cabinet/shelf/compartment/bin/bag)

Placements

placement_id [pk]

ambulance_id [fk] (which ambulance this placement applies to)

container_id [fk]

parent_container_id [fk] (where the container is placed in this layout)

Container Supplies

container_supply_id [pk]

container_id [fk] (which container the supply belongs to)

supply_id [fk] (which supply)

quantity (how many are required)


r/DatabaseHelp • • Feb 12 '24

Why is MySQL so difficult to use?

7 Upvotes

I am new to MySQL, I just learned PHP for some weeks.

I use MySQL with XAMPP, always various errors and very difficult to cope with.

Is MySQL really so difficult?

Thanks!


r/DatabaseHelp • • Dec 03 '21

Which database solution should I use for my needs?

6 Upvotes

I am establishing a new database for a hobby association group that is nationwide (US). Some context, it’s for a radio control sailing organization that governs the class at the national level.

Our needs are pretty basic, we need to maintain a running list of members of the association, be able to track payment invoices and member fees. Additionally, each boat must go through a certification process, and the completed certification (in PDF form) must be able to be attached (or transferred if the boat is sold to another member) to the members record.

I’d like to have this be web-based, so other officials of the organization do not require any additional software.

Does anyone have any pointers as to where I should start?

I have basic-level programming experience, but I’m capable of learning whatever is required to get this project completed.


r/DatabaseHelp • • Sep 28 '20

Connecting a database to a website

6 Upvotes

So I'm working with a group project for a class and we essentially need to connect our website to our database. Specifically, we need it so that when someone clicks a button on the site, a timestamp of when it was clicked will be stored in the database, and also a second button so that when pressed will show the newest entry in the database (ie the timestamp that was just sent). We have created a super basic "Hello World" website with a button that displays the timestamp and a database (no tables yet, since we don't know what we need in it), but we are stuck on how to actually connect the two, so that when the button is pressed the timestamp is sent (and how to retrieve the timestamp back). Is there anyone here who can help? If it helps, here is a link to our website:

http://csci2999b03yellow-env.eba-zhepcd2s.us-east-1.elasticbeanstalk.com/

It is down between 9pm-9am to save our AWS funds.


r/DatabaseHelp • • Sep 17 '20

For the life of me I can't figure out functional dependencies

6 Upvotes

I'm taking my first DB class and just can't grasp the concept. The examples in the book make sense, because they reference an actual table with values and only a few attributes. But when I have homework like

"Determine the functional dependencies of the following table: Student (StudID, StudName, Age, (AdvisorNum, AdvisorName, CourseNum, CourseName, CourseGrade))

I have no idea how to handle it. There are too many things listed together. And even if I can figure out some of them, I start thinking of all the possible combinations of attributes that could force other dependencies. (The above is something I made up; I don't want to actually cheat)

Any insight would be greatly appreciated.


r/DatabaseHelp • • Mar 06 '20

Normal form help

6 Upvotes

I made a database at home that houses information about various credit cards I have to keep track of them all, but mostly for the learning experience. Anywho, I'm trying to figure out how to normalize the database and that's always been my weak point.

I know that 2nf is eliminating partial dependencies and 3nf is eliminating transitive dependencies, but I struggle with that for soem reason. Wondering if someone can help walk me through how many tables I need and what should be in them.

Right now i have two tables:

  1. CardIssuers [issuerID, issuerName]

  2. CreditCards [CardID, IssuerID, CardName, AccountNum (just the last four or five depending on issuer), creditLimit, dateOpened, expDate, isActive]

The first table should be pretty self-explanatory. The second table includes the card ID, foreign IssuerID key, name of the card, the last numbers of the card number, the limit kn the card, the date the account was opened, the expiration date on the card (to be replaced every few years with the new number), and whether or not the card is still open.

Any help would be appreciated


r/DatabaseHelp • • Dec 22 '25

Trying to normalize data in a hobby project with a database

5 Upvotes

I have been using a Google Sheet to track the things I read (because no website seems to have all of them). I figured a simple website + database would be better in the long run. I have a database designed and mostly normalized. However, certain values are basically like values from an enum.

  • Volume:

    • PK

    • BookSeriesId (FK -> BookSeries)

    • VolumeNumber (Integer) (For sorting things like "Harry Potter and the ..." becasue alphabetical won't work.)

    • Name (String)

    • Status (Enum?)

This isn't the exact format of my data but the DB has become complex.

Statuses:

  • Planning

  • Reading

  • Caught Up

  • On Hold

  • Completed

  • Dropped

  • Skipped

I have similar simple tables for things like languages, countries, release status of the book.

It feels weird to make a table in the db for those 7 statuses and then reference them with a foreign key. However, my professional experience says that if I don't do that, then there will eventually be a typo in one of the rows where I put in "plnaning" or something. I have added new statuses or renamed them in the past, but it is super rare.

Hoping someone here can confidently tell me the best practice way to achieve this.


r/DatabaseHelp • • Nov 13 '25

A bit overwhelmed and mildly underbudget...

5 Upvotes

Hi all,

I know the title is massively vague but I assure you this is not a troll post.

I am attempting to build a financial dashboard using PowerBI with the data from my SQL db. Whilst the task in itself is self-explanatory, I'm really struggling to understand the different tables in the db.

Question 1, how do you start making sense of what tables I have and what data resides on those tables?

Question 2, I have exported a copy of the whole database so that I don't shaft myself by corrupting the live db, but if I were to open up the db from PowerBI as a "Direct Inquiry", how risky would this be in terms of corrupting the data and would this expose the data on a security level?

I guess what I'm trying to ask is, as a DBA working in a new environment, how do you make sense of what information resides where and how to go about building reports from that data?


r/DatabaseHelp • • Aug 16 '25

UML Class diagram: Aggregation vs Composition . Composition == ON DELETE CASCADE ?

5 Upvotes

So I had a script from a professor and I checked Wikipedia and I understand what the Class Diagram wants to model, but I don't understand why cardinality is not enough. Why do we need to fill out this diamond? Now it occurred to me that maybe they don't think about object oriented programming languages, but relational databases.

For example I could have a TABLE house and a TABLE room . When I demolish a house, the rooms still live in that table.

In MongoDb I might store the rooms in JSON inside the house. When I delete the item, the rooms are gone. UML has this list attribute. Clearly when I delete an object, all attributes are deleted, even when they are lists. Just weird to me that a class diagram meant for OOD suddenly uses type names instead of arrows. In OOP I learned that everything is an object. Objects are first class. Smalltalk and Python work this way. Yeah, but I guess that UML is for Java. Here some classes or more classy than others. So we have String and Int . I also hate this about databases in general, but I guess that this is just how it is. Microsoft tried to allow .NET classes in MS SQL server, but it did not caught on.

In Java the garbage collector both deletes list attributes and components because no one has a reference to them ( does an apple fall from the tree if I don't see it ?). When you want aggregation ( in a memory cache for consistency with persistence layer ), you need to construct an object pool.

JavaScript uses a Rope for all strings. I guess that the GC walks over this the same it walks over the other memory.

C++ is wild because Aggregation without a pool would lead to a memory leak which makes no sense.

I was confused because this looks like behavior . Ownership is something in Rust -- in the code, not the declarations. Class diagrams are about data structure. But then it I remembered SQL ( and not the T-SQL procedures ).

Still, in the end, what does cardinality 1--* aggregation would then mean? That the user of the database is responsible for the destruction of the components? But UML models the reality, the specs. Localization of behavior would be implementation.


r/DatabaseHelp • • Jul 06 '25

postgresql password not being enforced by postgresql, cause?

5 Upvotes

Whatever I do I can't get postgresql to enforce the password I assign to my role, I set the password using this:

ALTER USER usr with PASSWORD 'donkey'; it gives ALTER ROLE indicating it was a success

but then when accessing said user, it never asks for a password and allows me to do whatever I want.

I tested these:

postgresql://usr:wrongpw@localhost/db javascript connection string

and

psql -U usr -d db from terminal

they both work even though the first one has the wrong password and the second doesn't even have the password.

What could be causing this?


r/DatabaseHelp • • Apr 03 '25

Which data base software is best for customer information?

5 Upvotes

Hi, I'm working as a freelance mechanic and have a little bit of Python coding knowledge from highschool, I am trying to find a software that is client based (on my computer, not cloud based), that I can create customer profiles, that I can link to files in my computer (I take photos for each customer and each job and I have these organized and I want the data base to be able to refer to those folders.

And I'm probably a choosey begger but I'm hoping to find something free that can do this if possible, any good suggestions I would appreciate it!


r/DatabaseHelp • • Oct 22 '24

what is the best database for data entry (forms like) all the way down to invoicing and accounting?

5 Upvotes

is there a good database or suite of tools that include a database that can do most of what is needed in a small business? This "small business" is a small NGO that facilitates translators. So the product is a bunch of assignments as different calendar entries. I need a database or suite of tools that have synergy and I can take this pool of assignments, enter the assignment details like the length and driving costs and down the line create an invoice?


r/DatabaseHelp • • Sep 21 '24

Building database to store car service records with different tables

5 Upvotes

In simple terms I want to build a database to store service records for about 5 different cars, how many tables should I use? one for the cars themselves, one for the parts and one for the service records?

Obviously certain parts will only fit certain cars

Any direction to some extra reading would be much appreciated

Many thanks