Fruit flowers not getting polinated

[1voyager1]

Next Question:
OK, the Lilikoi seems to be putting out flushes of flowers.
The first one was the one that gave the single fruit.
The second flush, about a month after the first, set 3 more fruit.
It is beginning a third flush of flowers now.
The first fruit to set began to noticeably turn yellow a couple of weeks ago.
A few days ago I handled it to look at it.
It broke loose and fell to the ground.
Everything I read about what is a ripe lilikoi tells me that it is ripe when it drops.
But, it is still hard as a rock.
Although, when I shake it I can feel that something is moving around inside.
Do I need to wait for the skin to begin shriveling or is it ready now?

I've also read that they are usually not self-fertile.
That might explain why hand pollination did not work.
I might need to put in a second plant for cross fertilization to increase the "crop".
Any thoughts?