A proposal to build about 40 apartments on the former Binn Animal Rescue property in Ridgefield has been withdrawn. The developer’s attorney cited disagreements with the town’s Inland Wetlands Board over project design and review fees. The nearly 20-acre site has been the focus of ongoing debate about development and preserving green space.