Shopping cart sales rule not removed when applicable product removed from cart

[JesseEnd]

A sales rule for free shipping when a product is added to the cart is not removed when that product is removed from the cart.

Preconditions

1. Magento 2.1.2

Steps to reproduce

1. Create yes/no product attribute named 'Free Shipping', 'Use for Promo Rule Conditions' enabled
2. Add Free Shipping attribute to all attribute sets
3. Enable Free Shipping method with 100,000 minimum order amount (configuration -> sales -> shipping methods)
4. Create Cart Price Rule 'Free Shipping', no coupon, with the following conditions

If ALL of these conditions are TRUE :

If an item is FOUND  in the cart with ALL  of these conditions true:
    Free Shipping  is  Yes

5. Add action: Free Shipping 'For shipment with matching items'
6. Create 2 products: one with free shipping set to no (product 1), and one with free shipping set to yes (product 2)
7. Add product 1 to cart
8. Add product 2 to cart
9. Remove product 2 from cart

Expected result

1. Free shipping method should appear after product 2 is added to cart
2. Free shipping method should disappear after product 2 is removed from cart

Actual result

1. Free shipping method appears after product 2 is added to cart
2. Free shipping method stays after product 2 is removed from cart
3. Free shipping method stays after all products removed from cart and even when only product 1 is readded to cart

[SerhiyShkolyarenko]

@JesseEnd thank you for the report.
I tried and didn't reproduce the issue. Please, add some details:
Is value of 100,000 minimum order amount just a way to ensure we work with cart rule?
What are you products prices?
Which shipping methods are enabled?
Where do you check free shipping availability: on the cart page or on the checkout?
Please, add screenshots of the cart rule settings.

[JesseEnd]

Is value of 100,000 minimum order amount just a way to ensure we work with cart rule? That's correct
What are you products prices? Both are $500
Which shipping methods are enabled? Free Shipping and Fedex (Fedex's free method disabled)
Where do you check free shipping availability: on the cart page or on the checkout? Both the cart and checkout pages include the free shipping option when they shouldn't. However, creating an order in the backend works as expected.

Here is the install command I'm using (with my own details removed):
bin/magento setup:install --admin-firstname=***** --admin-lastname=***** --admin-email=***** --admin-user=***** --admin-password=***** --base-url=***** --backend-frontname=admin --db-host=localhost --db-name=***** --db-user=***** --db-password=***** --language=en_US --currency=CAD --timezone=America/Edmonton --use-rewrites=1 --use-secure=0 --base-url-secure=0 --use-secure-admin=0 --session-save=files -vvv

I just created a fresh install of Magento using the above command, added a subcategory, the attribute and sales rule, the 2 products, and set the shipping methods, and the issue still exists for me.

The only way I can get the free shipping option to disappear from the cart/checkout is to clear my browser's cookies. After clearing cookies, I can again reproduce the issue. I'm getting the same results in Firefox version 49.0.2 and Chrome version 54.0.2840.71

I've attached screenshots of Product 2 and the Cart Rule. Product 1 is identical to Product 2 except with 'Free Shipping' set to No.

[SerhiyShkolyarenko]

Reproduced the issue on 2.1.2
@JesseEnd is it reproducible for you on latest develop branch?

[JesseEnd]

On the latest develop branch cloned from github (2.2.0-dev), free shipping doesn't become an option in the cart at any point, even while Product 2 is in the cart.

[SerhiyShkolyarenko]

Created MAGETWO-60993 for 2.2.0 branch as blocker for this flow.