Partitions can end up out of order about tstorage HOT 2 OPEN

One possible solution is by setting the min timestamp in the memory partition constructor, and letting the creator enforce the min timestamp to never be less than the max timestamp of the previous partition.

@nakabonne let me know if I'm missing anything with this. Also, do you think this is a real issue and is it worth working on?

from tstorage.

@dpgil You're right. This is the issue that I've put off for a while. Basically most data points get timestamped on other programs, where timestamps are not always the same as the process tstorage runs on. Because of that, I presumed we don't determine the min timestamp until the first data point reached.

However, I was totally wrong. We can determine the next min timestamp by just incrementing to the previous max timestamp, a kind of like:

func (s *storage) ensureActiveHead() {
	head := s.partitionList.getHead()
	if head.active() {
		return
	}
	nextMin := head.maxTimestamp + 1

	// All partitions seems to be inactive so add a new partition to the list.
	p := newMemoryPartition(nextMin, s.wal, s.partitionDuration, s.timestampPrecision)

from tstorage.