Weekly Update - Krishna Khadka

Krishna:

Hi Group,

Action items completed last week:

Created a blog post website for my research project.

https://krishnakhadka200416.github.io/

After applying the adversarial approach and identifying key segments in images, I am encountering an issue where regions unimportant are being marked as important.. I’m having difficulty to get some good results. I need to do a thorough implementation check to make sure everything is correct. For example, the image below shows 5 important super-pixels identified by the approach, where the model identifies regions other than dog as important.

I would like to request a leave from tomorrow’s meeting due to attending a relative’s wedding reception in Austin.

Replies:
Dr. Lei:

the blog webpage looks good. yes, try to verify the validity of each step. also try tabular data.

Krishna:

Hello All,

Milestone: Select a new milestone date for paper submission. Set up internal deadlines to stay on track.

Currently, I’m working on integrating our approach, the adversarial generation, to LIME’s code framework for tabular and image dataset and then do the evaluation with LIME. I will present the evaluation results on Friday.

For the survey paper, I’ve completed an outline and looking for papers within the outline.

Krishna:

Hello Group,

Milestone: Submit a paper on Nov 10

Action items performed last week:

After Friday’s discussion, I have made some changes to the code to construct a logistic regression model for explaining image prediction.

Working on outlining for survey paper, identifying related papers.

Replies:
Dr. Lei:

can you outline the approach step by step, and then try to stick to the approach to see how each step works? also tabular data may be easier to prototype in the beginning.

Krishna:

Milestone: Submit a paper on Nov 10

The action items performed this week:

I implemented the approach made last week.

Generated adversarial of adversarial.

Trained a local model on those adversarial.

Generated a super pixel based feature importance.

I’m now working to setup evaluation with other approaches.

I have also been working on outlining for the survey paper on surrogate model construction. I will try to have a basic outline by Friday.

Krishna:

sure @Sunny

Krishna:

Hi Group,

Milestone: Make a paper submission Nov 9

Action items completed this week.

I’m exploring how to sample near the closest decision boundary, guided by normal to the decision boundary in the latent space identified, for constructing local surrogate model. Currently, I’m understanding how to construct a decision boundary in the latent space. Then sample along the normal to the decision boundary from the instance to explain. This is to ensure the samples used to train local model are realistic and more informative.

I’m also exploring more on constructing ensemble of decision trees using t features for reducing overfitting and better generalization during inference.

Replies:
Dr. Lei:

try to come up with a baseline approach for how to construct a local surrogate model. see my comments to pujan’s update

Krishna:

Hi All,

Milestone: Trained a local surrogate model on images generated using diffusion model Oct 8 :white_check_mark:

Major Milestone: Submit a paper to CAIN 2025 – Nov 9

This week I have been focusing on different approaches sample in the latent space. I’m exploring on how I can apply or improve one of these approaches for improving my project.

Replies:
Dr. Lei:

what are you findings about the local surrogate model you trained?

Krishna:

I haven’t yet done the evaluation part. However, I generated 100 perturbations using the diffusion model and trained a local CNN model and explain using integrated gradients, similar to LRP, approach.

Krishna:

Hi Group,

Milestone: Develop a local model using images generated by the diffusion model. – Oct 8

Following our discussion last week, I have been reviewing literature on approaches to improve the samples generated by the diffusion model.

My focus is primarily on research that utilizes the latent space of the diffusion model to create perturbations, as I believe this approach will be relevant for our project. I am also in process of implementing their code to generate images.

The paper is: https://ieeexplore.ieee.org/document/10581912

Replies:
Dr. Lei:

the goal of this project is to improve the quality of the instances sampled for building high-fidelity local models. the quality will be in terms of realism of individual instances and representativeness of all the instances.

Dr. Lei:

Two specific things we discussed but I have not got a clear idea is: (1) what are the existing sampling approaches for building local models? are there fundamental differences between those for high accuracy and those for high fidelity? (2) are there any existing work on sampling from latent space to build local surrogate models? Can you make a presentation on this today or Friday’s meeting? Please try to focus on these two things.

Krishna:

I will give a presentation on Friday

Krishna:

Hi All,

Milestone: Build a local surrogate model using images generated using diffusion model – 9/27

Action Items Performed Last Week:

Generated Image Perturbations by Modifying Superpixels:

I applied perturbations to t superpixels within images. This approach allows us to pinpoint superpixels critical to the model’s predictions by observing the decrease in prediction probability when these superpixels are altered, while maintaining visual similarity to the original image and unlike using black masking.

Generated Image Perturbations Using a Latent Stable Diffusion Model:

The latent stable diffusion model applies a diffusion process within an autoencoder framework. Given the large size of the original images, they are encoded into a latent space where the diffusion process is applied. The decoder then reconstructs the image back to its original form. This approach generated visually similar images that had same and different labels compared to the original labels.

Results from Generated Perturbations:

Original Prediction: Class ID 162

Class Prediction Counts (100 instances - 16 minutes):

Class ID 264: 68 instances

Class ID 251: 9 instances

Class ID 162: 1 instance

Class ID 222: 13 instances

Class ID 207: 5 instances

Class ID 208: 3 instances

Class ID 167: 1 instance

Next Steps: Training a CNN based local model based on these generated images to explain the LRP based decision-making process.
Replies:
Dr. Lei:

i don’t quite understand item 1. item 2 seems to be exactly what we would like. please explain the results in today’s meeting.

Krishna:

Hello All,

Milestone: Implement a baseline for local surrogate model
Action Items Done Last Week:

I have been looking into sampling ways for building local surrogate models in existing literature.

After Fridays, discussion, I tried using stable diffusion model to generate some noise in the input image. The process is time consuming.

I have also been working on building a local surrogate model using t-way sampling of the IPM generated from the metadata.

I plan on continuing my above tasks.

Replies:
Dr. Lei:

can you put a target date on the milestone? also did you finish your survey/presentation on local surrogate model?

Krishna:

Hi All,

Milestone: Prepare a presentation on local model building for friday’s meeting.

I have been collecting and reviewing research papers regarding local surrogate model building.

I have prepared a presentation for tomorrow where I will present an approach to build local surrogate model using t-way tests and interpret a black box prediction for tabular data.

Replies:
Dr. Lei:

look forward to the presentation tomorrow

Weekly Updates for Krishna Khadka

Enter Password

Weekly Updates for Krishna Khadka

Update: 2024-11-20

Update: 2024-11-12

Update: 2024-11-05

Update: 2024-10-29

Update: 2024-10-22

Update: 2024-10-15

Update: 2024-10-08

Update: 2024-10-01

Update: 2024-09-24

Update: 2024-09-17

Update: 2024-09-10

Enter Password