What to store large amounts of data.

Question

What to store large amounts of data.

There is a mySQL database. Not to make large requests to it every time I want to make a few .json/xml file where to write the answers to these queries. So it will be faster to work the website?
If to explain on fingers, for example there are 300 car brands, every brand dozens of models, and the models there are dozens of modifications to parameters. So to not pull in mySQL complex inner queries, can be saved as files?

Lourdes_Parker asked July 8th 19 at 11:16

Related questions

More answers about "What to store large amounts of data."

6 answers

marilyne_Roh answered on · Answer 1 · 2019-07-08T11:18:49.416Z

marilyne_Roh answered on July 8th 19 at 11:18

Kichirou in memcache

Kyleigh_Hills answered on · Answer 2 · 2019-07-08T11:20:49.417Z

I'll add to the answers and that it is better first to understand:
what is base, what are, what is the "key" field dependence, ДНФ3 as the base of different types arranged on the inside (the General principle), their architecture, system caching, and scaling.
Yes, this takes desire and time. But without it You will constantly ask questions such as:

So it will be faster to work the website?

I can answer the "head" to this question: will you do faceted search check box - use the "funnel" sampling in the streams of input data using a stored procedure.
But I'm afraid that it is unlikely to help You now.

Daphne_Roob answered on · Answer 3 · 2019-07-08T11:22:49.417Z

Daphne_Roob answered on July 8th 19 at 11:22

The fastest option is to generate json files and put them through nginx.
Files in memory satsire the operating system itself, and nginx will provide them with the fastest return.
The files are of the form: /brands.json /brand-0.json ... /brand-999.json

Can be cached in memory, but it will be slightly longer since every request will involve a scripting language, the connection with the cache. What seldom changes more optimally done at the file.

so I roughly had in mind ;) i.e., json files are faster mysql to work? - Lourdes_Parker commented on July 8th 19 at 11:25

: No options - return the finished file through nginx will always be faster. - Daphne_Roob commented on July 8th 19 at 11:28

Pedro_Herzog answered on · Answer 4 · 2019-07-08T11:24:49.417Z

Pedro_Herzog answered on July 8th 19 at 11:24

Maybe it is better to store in the database, and then cache them in the file? More flexibility and extensibility

and as the mysql cache? ;) sorry, I do not rummage - Lourdes_Parker commented on July 8th 19 at 11:27

Mysql not to cache, and the results of large queries - Daphne_Roob commented on July 8th 19 at 11:30

Giles_Funk63 answered on · Answer 5 · 2019-07-08T11:26:49.417Z

Giles_Funk63 answered on July 8th 19 at 11:26

1. query results can be cached in memcache or redis
2. large volumes-millions of rows in tables GB, maybe it's not your case?

well one of the tables in the database weighs in at almost 500MB.. other 50MB, 200MB.. - Lourdes_Parker commented on July 8th 19 at 11:29

Lourdes_Parker answered on · Answer 6 · 2019-07-08T11:28:49.417Z

Lourdes_Parker answered on July 8th 19 at 11:28

To make it clear what I mean: www.qfparts.ru/catalog
slowly it works?

Yes, slow, comfortable speed...
if you have a VPS, can be a simple solution for you will increase buffers in my.cnf - Lourdes_Parker commented on July 8th 19 at 11:31

Also analyze (EXPLAIN) the query can be indexes are not used. - Daphne_Roob commented on July 8th 19 at 11:34