Posts

Showing posts with the label kdb

KDB - Historical Table - what's the “right” way to doing it?

Image
Clash Royale CLAN TAG #URR8PPP KDB - Historical Table - what's the “right” way to doing it? I have a point of sale system that exports my data to a .csv which I then import into KDB. Currently what I do is export all the data from the POS to the csv and then create a single table. I have about 10 months of sales data and my csv file is about 11mb. As time grows I imagine that the csv file will be really huge and I wonder if this is inefficient. At my old job what we would do is have a table for each individual day of data and then there would be an _hist table which would combine all the daily files. So if I wanted to just look at the data for the day I would look at the invoicedata table and if I wanted to look across all time I would look at the invoidata_hist table and set the query to look at date within (dateA;dateB). I'm wondering if I should set things up this way rather than the way I'm doing it now. Am I better off having one very large csv file with all the d...