Fans of the two clubs have clashed before, with one spectator dying in 2022 after police fired tear gas to break up violence outside the stadium, which then drifted into the arena, causing breathing problems and panic.
Riquelme left his box along with some of the club's council members to pacify Boca fans as the match came to a halt due fans attempting to break down barriers in the stands to confront each other.
The players also pleaded with the fans and the police to calm down, and the tension eventually de-escalated.
Boca, who prevailed in the penalty shootout after a 1-1 stalemate, will play Velez Sarsfield in the semi-finals.