That blind spot is extremely common. Most people who inherit or stumble into a rental property start with the rent check and never separate the land value from the building value. It takes a specific moment, like the one you just had, to even think to ask the question.
Here is what the separation looks like. Your duplex has two distinct value layers. The building itself, which depreciates over time and eventually needs replacement, and the land underneath it, which does not depreciate and carries whatever the market says buildable ground is worth in that location. Assessors and appraisers often publish these separately, and county parcel records sometimes break them out. Your $68k comp (a comparable sale, meaning a nearby property that sold recently under similar conditions) is raw signal, not a direct answer, because that scraped lot may be a different size, a different zoning category, or in a slightly different part of the market.
The thing worth sitting with: R-2 zoning typically means low-density residential, often allowing duplexes or small multi-family, which matters if the land ever became more valuable than the improved property. That situation, called being worth more dirt than improved, happens in gentrifying areas and is worth knowing before somebody else figures it out first.
I would not act on any of this without talking to a local real estate attorney about what R-2 actually permits in that specific Ohio municipality, because zoning rules vary city by city. That conversation is inexpensive and clarifying.
Since you are starting to think about what the land itself is worth and what it could do, the Rena Real Estate Financial Fingerprint might be a useful next step. It maps 132 strategies, including land development, to your actual situation and tells you which ones fit and why. You can start with the free four-minute quiz at projectrena.com/quiz.
What does the county assessment show as the land-only value on your parcel?