Welcome to the #dominoforever Product Ideas Forum! The place where you can submit product ideas and enhancement request. We encourage you to participate by voting on, commenting on, and creating new ideas. All new ideas will be evaluated by HCL Product Management & Engineering teams, and the next steps will be communicated. While not all submitted ideas will be executed upon, community feedback will play a key role in influencing which ideas are and when they will be implemented.
For more information and upcoming events around #dominoforever, please visit our Destination Domino Page
Domino databases need to handle much larger data sets. We have a db with 7.5 million docs, 29gb, where views are required to be rebuilt many times a week, and it takes hours. With data sets growing, this isn't going to decrease. The way Domino indexes data needs to improve to stay relevant.
For example, I wrote a comment there about domlog: https://domino-ideas.hcltechsw.com/ideas/DOMINO-I-843
We now have 256 GB per Domino app, which is not "big data", but still pretty big. The issue with Domino is the NIF. You can have millions of documents in an app, but if you have millions of documents changing - adding, editing, updating, deleting, the NIF takes are large percentage of CPU. I think the person is talking about size limit, and the NIF.
I personally have never seen the problem at "half" the maximum size, but when the app gets really busy and large.
As for DB2, I don't think that changed that the NIF was still indexing on the Domino side.
I haven't had to use Domino to analyze big data or use as a back-end for a 10 node big-data demo. My test data was distributed and bigger than 256 GB, so I didn't even think about it.
Right now Lotus Notes can only handle a certain size database, it even slows down bad when it reaches half of it's limit. With companies keeping more and more data and trying to report against all of that data, it would be of benefit for Lotus Notes to preform much better and faster and with larger amounts of data. At one time, IBM attempted to allow use to change the data store to DB2, did not work out well. What if we could change the data store to MongoDB or some other large database system. We could keep all of the bells and whistle of the Notes UI and security just with a larger and/or more powerful back end DB.
Can you please provide more details on this idea? e.g. what kind of use case you are looking into, how the solution should work, etc.