fn get_links(link_nodes: Select) -> Option<String> {

        let mut rel_permalink: Option<String> = for node in link_nodes {
            link = String::from(node.value().attr("href")?);

            return Some(link);
        };

        Some(rel_permalink)
    }

This is what I’m trying to do, and I’ve been stuck with this code for an hour, I simply don’t know how to put this function togheter… Essentially I would like to take some link_nodes and just return the link String, but I’m stuck in the use of Option with the ? operator… Pheraps trying to write it with match would clear things out(?)

Also I come from JavaScript in which expressions do not have their own scope, meaning I’m having troubles to understand how to get out a variable from a for loop, should I initialize the rel_permalink variable as the for loop result?

This are the errors i get:

error[E0308]: mismatched types
  --> src/main.rs:55:49
   |
55 |           let mut rel_permalink: Option<String> = for node in link_nodes {
   |  _________________________________________________^
56 | |             link = String::from(node.value().attr("href")?);
57 | |
58 | |             return Some(link);
59 | |         };
   | |_________^ expected `Option<String>`, found `()`
   |
   = note:   expected enum `Option<String>`
           found unit type `()`
note: the function expects a value to always be returned, but loops might run zero times
  --> src/main.rs:55:49
   |
55 |         let mut rel_permalink: Option<String> = for node in link_nodes {
   |                                                 ^^^^^^^^^^^^^^^^^^^^^^ this might have zero elements to iterate on
56 |             link = String::from(node.value().attr("href")?);
   |                                                          - if the loop doesn't execute, this value would never get returned
57 |
58 |             return Some(link);
   |             ----------------- if the loop doesn't execute, this value would never get returned
   = help: return a value for the case when the loop has zero elements to iterate on, or consider changing the return type to account for that possibility
  • gigapixel@mastodontti.fi
    link
    fedilink
    arrow-up
    1
    ·
    2 months ago

    @dontblink Here’s a little explanation for the methods
    - into\_iter : converts Select into an iterator (a for loop does this implicitly)
    - filter\_map: takes an iterator and constructs an iterator from an Fn(T) -\> Option\<S\> where the emitted elements are the elements for which applying the function/closure is Some
    - next: takes the next element of the iterator as an Option.

      • gigapixel@mastodontti.fi
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        2 months ago

        @dontblink If you really want to do it in a loop, you could do something like

        fn get\_links(link\_nodes: Select) -\> Option\<String\> {  
         let mut rel\_permalink: Option\<String\> = None;  
         for node in link\_nodes {  
         if let Some(link) = node.value().attr("href")? {  
         rel\_permalink = Some(String::from(link));  
         break  
         }  
         };  
         rel\_permalink  
        }  
        

        That said, your function name suggest you want _all_ links, so some kind of collection of links. Is this the case?

        • dontblinkOP
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 months ago

          Hi! First of all thank you so much for the detailed explanation!

          What I’m trying to do is scraping some content.

          Yes I’m trying to return all links (maybe in a vector), I have a list of elements (Select, which actually is scraper::html::Select<'_, '_>) which contain essentially html nodes selections, and I would like to grab each of them, extract the actual link value (&str), convert it into an actual String and push it firstly into a vector containing all the links and then in an istance of a struct which will contain several datas about the scraped page later.

          I was trying to use a for loop because that was the first structure that came to my mind, I’m finding it hard to wrap my head around ownership and error handling with rust, using the if let construct can be a good idea, and I didn’t consider the use of break!

          I also managed to build the “match version” of what I was trying to achieve:

          fn get_links(link_nodes: scraper::html::Select<'_, '_>) -> Vec<String> {
                  let mut links = vec![];
          
                  for node in link_nodes {
                      match node.value().attr("href") {
                          Some(link) => {
                              links.push(link.to_string());
                          }
                          None => (),
                      }
                  }
          
                  dbg!(&links);
                  links
              }
          

          I didn’t understand that I had to return the same type for each of the Option match arms, I thought enum variants could have different types, so if the Some match arm returns (), also None has to do the same…

          If I try with a simpler example I still cannot understand why I cannot do something like:

          enum OperativeSystem {
                      Linux,
                      Windows,
                      Mac,
                      Unrecognised,
                  }
          
                  let absent_os = OperativeSystem::Unrecognised;
                  find_os(absent_os);
          
                  fn find_os(os: OperativeSystem) -> String {
                      match os {
                          debian => {
                              let answer = "This pc uses Linux";
                              answer.to_string()
                          }
                          windows10home => {
                              let answer = "This pc uses Windows, unlucky you!";
                              answer.to_string()
                          }
                          ios15 => {
                              let answer = "This pc uses Mac, I'm really sorry!";
                              answer.to_string()
                          }
                          _ => {
                              let is_unrecognised = true;
                              is_unrecognised
                          }
                      }
                  }
          

          match is much more intuitive for a beginner, there’s a lot of stuff which go under the hood with ?

          • gigapixel@mastodontti.fi
            link
            fedilink
            arrow-up
            1
            ·
            2 months ago

            @dontblink Yeah, I think it makes sense to use match as a beginner just to understand what is going on. In the end the x? just desugars to

            match x {  
             Some(value) =\> value,  
             None =\> return None  
            }  
            

            for options an

            match x {  
             Ok(value) =\> value,  
             Err(err) =\> return Err(err.into())  
            }  
            

            for results, where that .into() converts the error type into the return type of function.

            • gigapixel@mastodontti.fi
              link
              fedilink
              arrow-up
              1
              ·
              2 months ago

              @dontblink For stuff like this, I tend to prefer rusts iterator combinators, but I admit it’s a bit more advanced. So in this case you’d do

              fn get\_links(link\_nodes: scraper::html::Select\<'\_, '\_\>) -\> Vec\<String\> {  
               link\_nodes  
               .into\_iter() // convert select to iterator  
               .filter\_map(|node| node.value().attr("href")) // only select nodes with an href attribute, and select that value  
               .map(ToString::to\_string) // map that value to a string  
               .collect()  
              }
              
              
              • gigapixel@mastodontti.fi
                link
                fedilink
                arrow-up
                1
                ·
                2 months ago

                @dontblink The idea of the iterator is to assemble all of your computation lazily and only perform it at the final step. In this case you don’t actually perform any the actions until you call collect, which essentially creates a loop that goes through the original Select and performs the calculations and pushes the results to a Vec.

                • gigapixel@mastodontti.fi
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  edit-2
                  2 months ago

                  @dontblink

                  enum OperativeSystem {  
                   Linux,  
                   Windows,  
                   Mac,  
                   Unrecognised,  
                  }
                  
                  fn find\_os(os: OperativeSystem) -\> String {  
                   match os {  
                   OperativeSystem::Linux =\> "This pc uses Linux".into(),  
                   OperativeSystem::Windows =\> "This pc uses Windows, unlucky you!".into(),  
                   OperativeSystem::Mac =\> "This pc uses Mac, I'm really sorry!".into(),  
                   \_ =\> "unrecognised".into(),  
                   }  
                  }  
                  

                  If you want to return either a Boolean or a String you can introduce an enum

                  • gigapixel@mastodontti.fi
                    link
                    fedilink
                    arrow-up
                    1
                    ·
                    2 months ago

                    @dontblink e.g.

                    enum OsResponseType {  
                     Message { message: String },  
                     Bool(bool),  
                    }
                    
                    fn find\_os(os: OperativeSystem) -\> OsResponseType {  
                     match os {  
                     OperativeSystem::Linux =\> OsResponseType::Message {  
                     message: "This pc uses Linux".into(),  
                     },  
                     OperativeSystem::Windows =\> OsResponseType::Bool(false),  
                     OperativeSystem::Mac =\> OsResponseType::Bool(true),  
                     \_ =\> OsResponseType::Bool(false),  
                     }  
                    }  
                    

                    Note the logic here is nonsense

          • asudox@programming.dev
            link
            fedilink
            arrow-up
            1
            ·
            edit-2
            1 month ago

            Here’s what you are trying to do, with a one liner:

            fn get_links(mut link_nodes: Select) -> Vec<String> {
                link_nodes.retain(|node| node.value().attr("href").is_some()).into_iter().fold(Vec::new(), |links, node| links.push(link.value().attr("href").unwrap().to_string()))
            }
            

            edit: shorter and updated version:

            fn get_links(mut link_nodes: Select) -> Vec<String> {
                link_nodes.into_iter().filter_map(|node| node.value().attr("href").map(|href| href.to_string())).collect()
            }
            

            The retain method is to get rid of all the nodes which don’t have a href attribute and the fold method after it is to extract the href out of the nodes and push them into the vector.

            It might work or not, I’ve written this from my memory and I can’t exactly know what that Select is.

            I also hope you begin reading The Book without half assing it.

            • taladar@sh.itjust.works
              link
              fedilink
              arrow-up
              2
              ·
              1 month ago

              You should use filter_map instead of the retain and later unwrapping and you don’t need a fold to build a Vec from an iterator, you can just use collect for that at the end.

              • asudox@programming.dev
                link
                fedilink
                arrow-up
                1
                ·
                1 month ago

                here, it definitely is shorter, I’ll keep filter_map in mind, thanks:

                fn get_links(mut link_nodes: Select) -> Vec<String> {
                    link_nodes.into_iter().filter_map(|node| node.value().attr("href").map(|href| href.to_string())).collect()
                }